Nov 15 01:09:30 user nova-compute[74880]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74880) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 01:09:30 user nova-compute[74880]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74880) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 01:09:30 user nova-compute[74880]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74880) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 01:09:30 user nova-compute[74880]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 01:09:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:09:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:09:30 user nova-compute[74880]: INFO nova.virt.driver [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 01:09:30 user nova-compute[74880]: INFO nova.compute.provider_config [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Acquiring lock "singleton_lock" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Acquired lock "singleton_lock" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Releasing lock "singleton_lock" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Full set of CONF: {{(pid=74880) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ******************************************************************************** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Configuration options gathered from: {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ================================================================================ {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] allow_resize_to_same_host      = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] arq_binding_timeout            = 300 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] backdoor_port                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] backdoor_socket                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] block_device_allocate_retries  = 300 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] block_device_allocate_retries_interval = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cert                           = self.pem {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute_monitors               = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] config_dir                     = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] config_drive_format            = iso9660 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] config_source                  = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] console_host                   = user {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] control_exchange               = nova {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cpu_allocation_ratio           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] daemon                         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] debug                          = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] default_access_ip_network_name = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] default_availability_zone      = nova {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] default_ephemeral_format       = ext4 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] default_green_pool_size        = 1000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] default_schedule_zone          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] disk_allocation_ratio          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] enable_new_services            = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] enabled_ssl_apis               = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] flat_injected                  = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] force_config_drive             = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] force_raw_images               = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] graceful_shutdown_timeout      = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] heal_instance_info_cache_interval = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] host                           = user {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_build_timeout         = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_delete_interval       = 300 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_name_template         = instance-%08x {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_usage_audit           = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_usage_audit_period    = month {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] internal_service_availability_zone = internal {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] key                            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] live_migration_retry_count     = 30 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_config_append              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_dir                        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_file                       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_options                    = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_rotate_interval            = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_rotate_interval_type       = days {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] log_rotation_type              = none {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] long_rpc_timeout               = 1800 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] max_concurrent_builds          = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] max_concurrent_live_migrations = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] max_concurrent_snapshots       = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] max_local_block_devices        = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] max_logfile_count              = 30 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] max_logfile_size_mb            = 200 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] maximum_instance_delete_attempts = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metadata_listen                = 0.0.0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metadata_listen_port           = 8775 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metadata_workers               = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] migrate_max_retries            = -1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] mkisofs_cmd                    = genisoimage {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] my_ip                          = 10.0.0.210 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] network_allocate_retries       = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] osapi_compute_listen_port      = 8774 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] osapi_compute_unique_server_name_scope =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] osapi_compute_workers          = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] password_length                = 12 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] periodic_enable                = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] periodic_fuzzy_delay           = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] pointer_model                  = ps2mouse {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] preallocate_images             = none {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] publish_errors                 = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] pybasedir                      = /opt/stack/nova {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ram_allocation_ratio           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rate_limit_burst               = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rate_limit_except_level        = CRITICAL {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rate_limit_interval            = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reboot_timeout                 = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reclaim_instance_interval      = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] record                         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reimage_timeout_per_gb         = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] report_interval                = 120 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rescue_timeout                 = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reserved_host_cpus             = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reserved_host_disk_mb          = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reserved_host_memory_mb        = 512 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] reserved_huge_pages            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] resize_confirm_window          = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] resize_fs_using_block_device   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] resume_guests_state_on_host_boot = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rpc_response_timeout           = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] run_external_periodic_tasks    = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] running_deleted_instance_action = reap {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] running_deleted_instance_timeout = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler_instance_sync_interval = 120 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_down_time              = 720 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] servicegroup_driver            = db {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] shelved_offload_time           = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] shelved_poll_interval          = 3600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] shutdown_timeout               = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] source_is_ipv6                 = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ssl_only                       = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] state_path                     = /opt/stack/data/nova {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] sync_power_state_interval      = 600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] sync_power_state_pool_size     = 1000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] syslog_log_facility            = LOG_USER {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] tempdir                        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] timeout_nbd                    = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] transport_url                  = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] update_resources_interval      = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_cow_images                 = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_eventlog                   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_journal                    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_json                       = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_rootwrap_daemon            = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_stderr                     = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] use_syslog                     = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vcpu_pin_set                   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plugging_is_fatal          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plugging_timeout           = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] virt_mkfs                      = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] volume_usage_poll_interval     = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] watch_log_file                 = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] web                            = /usr/share/spice-html5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_concurrency.disable_process_locking = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.auth_strategy              = keystone {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.compute_link_prefix        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.dhcp_domain                = novalocal {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.enable_instance_password   = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.glance_link_prefix         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.instance_list_per_project_cells = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.list_records_by_skipping_down_cells = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.local_metadata_per_cell    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.max_limit                  = 1000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.metadata_cache_expiration  = 15 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.neutron_default_tenant_id  = default {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.use_forwarded_for          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.use_neutron_default_nets   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_dynamic_targets = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_jsonfile_path   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.backend_argument         = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.config_prefix            = cache.oslo {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.dead_timeout             = 60.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.debug_cache_backend      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.enable_retry_client      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.enable_socket_keepalive  = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.enabled                  = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.expiration_time          = 600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.hashclient_retry_attempts = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_dead_retry      = 300 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_password        =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_sasl_enabled    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.memcache_username        =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.proxies                  = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.retry_attempts           = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.retry_delay              = 0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.socket_keepalive_count   = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.socket_keepalive_idle    = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.socket_keepalive_interval = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.tls_allowed_ciphers      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.tls_cafile               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.tls_certfile             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.tls_enabled              = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cache.tls_keyfile              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.auth_section            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.auth_type               = password {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.cafile                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.certfile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.collect_timing          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.cross_az_attach         = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.debug                   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.endpoint_template       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.http_retries            = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.insecure                = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.keyfile                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.os_region_name          = RegionOne {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.split_loggers           = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cinder.timeout                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.cpu_dedicated_set      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.cpu_shared_set         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.image_type_exclude_list = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.resource_provider_association_refresh = 300 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.shutdown_retry_interval = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] conductor.workers              = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] console.allowed_origins        = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] console.ssl_ciphers            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] console.ssl_minimum_version    = default {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] consoleauth.token_ttl          = 600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.cafile                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.certfile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.collect_timing          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.connect_retries         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.connect_retry_delay     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.endpoint_override       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.insecure                = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.keyfile                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.max_version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.min_version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.region_name             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.service_name            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.service_type            = accelerator {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.split_loggers           = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.status_code_retries     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.timeout                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] cyborg.version                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.backend               = sqlalchemy {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.connection            = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.connection_debug      = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.connection_parameters =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.connection_recycle_time = 3600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.connection_trace      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.db_inc_retry_interval = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.db_max_retries        = 20 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.db_max_retry_interval = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.db_retry_interval     = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.max_overflow          = 50 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.max_pool_size         = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.max_retries           = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.mysql_wsrep_sync_wait = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.pool_timeout          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.retry_interval        = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.slave_connection      = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] database.sqlite_synchronous    = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.backend           = sqlalchemy {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.connection        = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.connection_debug  = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.connection_parameters =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.connection_recycle_time = 3600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.connection_trace  = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.db_inc_retry_interval = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.db_max_retries    = 20 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.db_max_retry_interval = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.db_retry_interval = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.max_overflow      = 50 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.max_pool_size     = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.max_retries       = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.pool_timeout      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.retry_interval    = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.slave_connection  = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] api_database.sqlite_synchronous = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] devices.enabled_mdev_types     = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ephemeral_storage_encryption.enabled = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.api_servers             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.cafile                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.certfile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.collect_timing          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.connect_retries         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.connect_retry_delay     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.debug                   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.default_trusted_certificate_ids = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.enable_certificate_validation = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.enable_rbd_download     = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.endpoint_override       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.insecure                = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.keyfile                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.max_version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.min_version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.num_retries             = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.rbd_ceph_conf           =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.rbd_connect_timeout     = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.rbd_pool                =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.rbd_user                =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.region_name             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.service_name            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.service_type            = image {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.split_loggers           = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.status_code_retries     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.timeout                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.verify_glance_signatures = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] glance.version                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] guestfs.debug                  = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.config_drive_cdrom      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.config_drive_inject_password = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.enable_remotefx         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.instances_path_share    =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.limit_cpu_features      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.use_multipath_io        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.vswitch_name            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] mks.enabled                    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] image_cache.manager_interval   = 2400 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] image_cache.precache_concurrency = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] image_cache.remove_unused_base_images = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] image_cache.subdirectory_name  = _base {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.api_max_retries         = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.api_retry_interval      = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.auth_section            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.auth_type               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.cafile                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.certfile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.collect_timing          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.conductor_group         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.connect_retries         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.connect_retry_delay     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.endpoint_override       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.insecure                = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.keyfile                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.max_version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.min_version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.peer_list               = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.region_name             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.serial_console_state_timeout = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.service_name            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.service_type            = baremetal {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.split_loggers           = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.status_code_retries     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.timeout                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ironic.version                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] key_manager.fixed_key          = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.barbican_api_version  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.barbican_endpoint     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.barbican_endpoint_type = public {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.barbican_region_name  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.cafile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.certfile              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.collect_timing        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.insecure              = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.keyfile               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.number_of_retries     = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.retry_delay           = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.send_service_user_token = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.split_loggers         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.timeout               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.verify_ssl            = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican.verify_ssl_path       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.auth_section = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.auth_type = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.cafile   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.certfile = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.collect_timing = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.insecure = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.keyfile  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.split_loggers = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] barbican_service_user.timeout  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.approle_role_id          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.approle_secret_id        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.cafile                   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.certfile                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.collect_timing           = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.insecure                 = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.keyfile                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.kv_mountpoint            = secret {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.kv_path                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.kv_version               = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.namespace                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.root_token_id            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.split_loggers            = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.ssl_ca_crt_file          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.timeout                  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.use_ssl                  = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.auth_section          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.auth_type             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.cafile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.certfile              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.collect_timing        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.connect_retries       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.connect_retry_delay   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.endpoint_override     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.insecure              = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.keyfile               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.max_version           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.min_version           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.region_name           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.service_name          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.service_type          = identity {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.split_loggers         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.status_code_retries   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.timeout               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] keystone.version               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.connection_uri         =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_mode               = custom {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: WARNING oslo_config.cfg [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_power_governor_high = performance {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_power_management   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.device_detach_attempts = 8 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.device_detach_timeout  = 20 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.disk_cachemodes        = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.disk_prefix            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.enabled_perf_events    = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.file_backed_memory     = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.gid_maps               = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.hw_disk_discard        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.hw_machine_type        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_rbd_pool        = rbd {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_type            = default {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.images_volume_group    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.inject_key             = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.inject_partition       = -2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.inject_password        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.iscsi_iface            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.iser_use_multipath     = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_downtime = 500 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_inbound_addr = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_scheme  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_timeout_action = abort {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_tunnelled = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: WARNING oslo_config.cfg [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 01:09:31 user nova-compute[74880]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 01:09:31 user nova-compute[74880]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 01:09:31 user nova-compute[74880]: and ``live_migration_inbound_addr`` respectively.
Nov 15 01:09:31 user nova-compute[74880]: ).  Its value may be silently ignored in the future.
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.live_migration_with_native_tls = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.max_queues             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.nfs_mount_options      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.num_pcie_ports         = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.pmem_namespaces        = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.quobyte_client_cfg     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rbd_secret_uuid        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rbd_user               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rescue_image_id        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rescue_kernel_id       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.rx_queue_size          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.smbfs_mount_options    =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.snapshot_compression   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.snapshot_image_format  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.sparse_logical_volumes = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.swtpm_enabled          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.swtpm_group            = tss {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.swtpm_user             = tss {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.sysinfo_serial         = unique {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.tb_cache_size          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.tx_queue_size          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.uid_maps               = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.use_virtio_for_bridges = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.virt_type              = kvm {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.volume_clear           = zero {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.volume_clear_size      = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.volume_use_multipath   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_cache_path   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.auth_section           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.auth_type              = password {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.cafile                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.certfile               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.collect_timing         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.connect_retries        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.connect_retry_delay    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.default_floating_pool  = public {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.endpoint_override      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.extension_sync_interval = 600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.http_retries           = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.insecure               = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.keyfile                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.max_version            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.min_version            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.ovs_bridge             = br-int {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.physnets               = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.region_name            = RegionOne {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.service_metadata_proxy = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.service_name           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.service_type           = network {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.split_loggers          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.status_code_retries    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.timeout                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] neutron.version                = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] notifications.bdms_in_notifications = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] notifications.default_level    = INFO {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] notifications.notification_format = unversioned {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] notifications.notify_on_state_change = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] pci.alias                      = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] pci.device_spec                = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] pci.report_in_placement        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.auth_section         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.auth_type            = password {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.cafile               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.certfile             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.collect_timing       = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.connect_retries      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.connect_retry_delay  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.default_domain_id    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.default_domain_name  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.domain_id            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.domain_name          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.endpoint_override    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.insecure             = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.keyfile              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.max_version          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.min_version          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.password             = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.project_domain_id    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.project_domain_name  = Default {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.project_id           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.project_name         = service {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.region_name          = RegionOne {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.service_name         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.service_type         = placement {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.split_loggers        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.status_code_retries  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.system_scope         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.timeout              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.trust_id             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.user_domain_id       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.user_domain_name     = Default {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.user_id              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.username             = placement {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] placement.version              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.cores                    = 20 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.count_usage_from_placement = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.injected_file_content_bytes = 10240 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.injected_file_path_length = 255 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.injected_files           = 5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.instances                = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.key_pairs                = 100 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.metadata_items           = 128 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.ram                      = 51200 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.recheck_quota            = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.server_group_members     = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] quota.server_groups            = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rdp.enabled                    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.image_metadata_prefilter = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.max_attempts         = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.max_placement_results = 1000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] scheduler.workers              = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.host_subset_size = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.isolated_hosts = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.isolated_images = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.pci_in_placement = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.track_instance_changes = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metrics.required               = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metrics.weight_multiplier      = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] metrics.weight_setting         = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] serial_console.enabled         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] serial_console.port_range      = 10000:20000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] serial_console.serialproxy_port = 6083 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.auth_section      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.auth_type         = password {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.cafile            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.certfile          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.collect_timing    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.insecure          = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.keyfile           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.send_service_user_token = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.split_loggers     = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] service_user.timeout           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.agent_enabled            = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.enabled                  = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.html5proxy_port          = 6082 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.image_compression        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.jpeg_compression         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.playback_compression     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.server_listen            = 127.0.0.1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.streaming_mode           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] spice.zlib_compression         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] upgrade_levels.baseapi         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] upgrade_levels.cert            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] upgrade_levels.compute         = auto {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] upgrade_levels.conductor       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] upgrade_levels.scheduler       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.cafile = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.certfile = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.insecure = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vendordata_dynamic_auth.timeout = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.api_retry_count         = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.ca_file                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.cache_prefix            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.cluster_name            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.connection_pool_size    = 10 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.console_delay_seconds   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.datastore_regex         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.host_ip                 = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.host_password           = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.host_port               = 443 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.host_username           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.insecure                = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.integration_bridge      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.maximum_objects         = 100 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.pbm_default_policy      = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.pbm_enabled             = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.pbm_wsdl_location       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.serial_port_proxy_uri   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.serial_port_service_uri = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.task_poll_interval      = 0.5 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.use_linked_clone        = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.vnc_keymap              = en-us {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.vnc_port                = 5900 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vmware.vnc_port_total          = 10000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.auth_schemes               = ['none'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.enabled                    = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.novncproxy_port            = 6080 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.vencrypt_ca_certs          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.vencrypt_client_cert       = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vnc.vencrypt_client_key        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.disable_rootwrap   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.enable_numa_live_migration = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.libvirt_disable_apic = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.client_socket_timeout     = 900 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.default_pool_size         = 1000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.keep_alive                = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.max_header_line           = 16384 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.ssl_ca_file               = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.ssl_cert_file             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.ssl_key_file              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.tcp_keepidle              = 600 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] zvm.ca_file                    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] zvm.cloud_connector_url        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] zvm.reachable_timeout          = 300 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.enforce_new_defaults = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.enforce_scope      = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.policy_default_rule = default {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.connection_string     = messaging:// {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.enabled               = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.es_doc_type           = notification {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.es_scroll_size        = 10000 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.es_scroll_time        = 2m {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.filter_error_trace    = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.hmac_keys             = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.sentinel_service_name = mymaster {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.socket_timeout        = 0.1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.trace_requests        = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler.trace_sqlalchemy      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler_jaeger.process_tags   = {} {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler_jaeger.service_name_prefix = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] profiler_otlp.service_name_prefix = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] remote_debug.host              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] remote_debug.port              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_notifications.retry = -1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.auth_section        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.auth_type           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.cafile              = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.certfile            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.collect_timing      = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.connect_retries     = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.connect_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.endpoint_id         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.endpoint_override   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.insecure            = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.keyfile             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.max_version         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.min_version         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.region_name         = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.service_name        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.service_type        = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.split_loggers       = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.status_code_retries = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.status_code_retry_delay = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.timeout             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.valid_interfaces    = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_limit.version             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_reports.file_event_handler = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] oslo_reports.log_dir           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_ovs_privileged.group  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] vif_plug_ovs_privileged.user   = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.isolate_vif         = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] os_brick.lock_path             = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] privsep_osbrick.capabilities   = [21] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] privsep_osbrick.group          = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] privsep_osbrick.helper_command = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] privsep_osbrick.user           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] nova_sys_admin.group           = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] nova_sys_admin.helper_command  = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] nova_sys_admin.user            = None {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG oslo_service.service [None req-66225549-c7e3-4c10-9085-d6ad809634d0 None None] ******************************************************************************** {{(pid=74880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 01:09:31 user nova-compute[74880]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Connecting to libvirt: qemu:///system {{(pid=74880) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9510aa3040> {{(pid=74880) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 01:09:31 user nova-compute[74880]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 01:09:31 user nova-compute[74880]: WARNING nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9510aa3040> {{(pid=74880) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Starting native event thread {{(pid=74880) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Starting green dispatch thread {{(pid=74880) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Starting connection event dispatch thread {{(pid=74880) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 01:09:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Connection event '1' reason 'None'
Nov 15 01:09:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 01:09:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.mount [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Initialising _HostMountState generation 0 {{(pid=74880) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 01:09:39 user nova-compute[74880]: INFO nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host capabilities <capabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <host>
Nov 15 01:09:39 user nova-compute[74880]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 01:09:39 user nova-compute[74880]:     <cpu>
Nov 15 01:09:39 user nova-compute[74880]:       <arch>x86_64</arch>
Nov 15 01:09:39 user nova-compute[74880]:       <model>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <microcode version='1070'/>
Nov 15 01:09:39 user nova-compute[74880]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='osxsave'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='invtsc'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='rsba'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 01:09:39 user nova-compute[74880]:       <pages unit='KiB' size='4'/>
Nov 15 01:09:39 user nova-compute[74880]:       <pages unit='KiB' size='2048'/>
Nov 15 01:09:39 user nova-compute[74880]:     </cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <power_management>
Nov 15 01:09:39 user nova-compute[74880]:       <suspend_mem/>
Nov 15 01:09:39 user nova-compute[74880]:       <suspend_disk/>
Nov 15 01:09:39 user nova-compute[74880]:       <suspend_hybrid/>
Nov 15 01:09:39 user nova-compute[74880]:     </power_management>
Nov 15 01:09:39 user nova-compute[74880]:     <iommu support='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <migration_features>
Nov 15 01:09:39 user nova-compute[74880]:       <live/>
Nov 15 01:09:39 user nova-compute[74880]:       <uri_transports>
Nov 15 01:09:39 user nova-compute[74880]:         <uri_transport>tcp</uri_transport>
Nov 15 01:09:39 user nova-compute[74880]:         <uri_transport>rdma</uri_transport>
Nov 15 01:09:39 user nova-compute[74880]:       </uri_transports>
Nov 15 01:09:39 user nova-compute[74880]:     </migration_features>
Nov 15 01:09:39 user nova-compute[74880]:     <topology>
Nov 15 01:09:39 user nova-compute[74880]:       <cells num='2'>
Nov 15 01:09:39 user nova-compute[74880]:         <cell id='0'>
Nov 15 01:09:39 user nova-compute[74880]:           <memory unit='KiB'>8140616</memory>
Nov 15 01:09:39 user nova-compute[74880]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 15 01:09:39 user nova-compute[74880]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 01:09:39 user nova-compute[74880]:           <distances>
Nov 15 01:09:39 user nova-compute[74880]:             <sibling id='0' value='10'/>
Nov 15 01:09:39 user nova-compute[74880]:             <sibling id='1' value='20'/>
Nov 15 01:09:39 user nova-compute[74880]:           </distances>
Nov 15 01:09:39 user nova-compute[74880]:           <cpus num='6'>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 01:09:39 user nova-compute[74880]:           </cpus>
Nov 15 01:09:39 user nova-compute[74880]:         </cell>
Nov 15 01:09:39 user nova-compute[74880]:         <cell id='1'>
Nov 15 01:09:39 user nova-compute[74880]:           <memory unit='KiB'>8255068</memory>
Nov 15 01:09:39 user nova-compute[74880]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 15 01:09:39 user nova-compute[74880]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 01:09:39 user nova-compute[74880]:           <distances>
Nov 15 01:09:39 user nova-compute[74880]:             <sibling id='0' value='20'/>
Nov 15 01:09:39 user nova-compute[74880]:             <sibling id='1' value='10'/>
Nov 15 01:09:39 user nova-compute[74880]:           </distances>
Nov 15 01:09:39 user nova-compute[74880]:           <cpus num='6'>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 01:09:39 user nova-compute[74880]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 01:09:39 user nova-compute[74880]:           </cpus>
Nov 15 01:09:39 user nova-compute[74880]:         </cell>
Nov 15 01:09:39 user nova-compute[74880]:       </cells>
Nov 15 01:09:39 user nova-compute[74880]:     </topology>
Nov 15 01:09:39 user nova-compute[74880]:     <cache>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 01:09:39 user nova-compute[74880]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 01:09:39 user nova-compute[74880]:     </cache>
Nov 15 01:09:39 user nova-compute[74880]:     <secmodel>
Nov 15 01:09:39 user nova-compute[74880]:       <model>apparmor</model>
Nov 15 01:09:39 user nova-compute[74880]:       <doi>0</doi>
Nov 15 01:09:39 user nova-compute[74880]:     </secmodel>
Nov 15 01:09:39 user nova-compute[74880]:     <secmodel>
Nov 15 01:09:39 user nova-compute[74880]:       <model>dac</model>
Nov 15 01:09:39 user nova-compute[74880]:       <doi>0</doi>
Nov 15 01:09:39 user nova-compute[74880]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 01:09:39 user nova-compute[74880]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 01:09:39 user nova-compute[74880]:     </secmodel>
Nov 15 01:09:39 user nova-compute[74880]:   </host>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='alpha'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>clipper</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='armv6l'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>spitz</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>nuri</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>kzm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sx1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>z2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>tosa</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>n810</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>n800</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>terrier</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>midway</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>microbit</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>verdex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>highbank</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>akita</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>connex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>collie</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='armv7l'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>spitz</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>nuri</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>kzm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sx1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>z2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>tosa</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>n810</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>n800</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>terrier</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>midway</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>microbit</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>verdex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>highbank</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>akita</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>connex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>collie</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='aarch64'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>spitz</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>nuri</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>kzm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sx1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>z2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>tosa</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>n810</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>n800</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>terrier</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>midway</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>microbit</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>verdex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>highbank</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>akita</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>connex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>collie</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <acpi default='on' toggle='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='cris'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='i686'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>isapc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>microvm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='kvm'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <pae/>
Nov 15 01:09:39 user nova-compute[74880]:       <nonpae/>
Nov 15 01:09:39 user nova-compute[74880]:       <acpi default='on' toggle='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:       <apic default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='m68k'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>an5206</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>q800</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='microblaze'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='microblazeel'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='mips'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='16'>malta</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='mipsel'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='16'>malta</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='mips64'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='16'>malta</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>pica61</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>magnum</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='mips64el'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='16'>malta</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>pica61</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>magnum</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='16'>boston</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='ppc'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mac99</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>40p</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>taihu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='ppc64'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>taihu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>40p</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mac99</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='ppc64le'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>taihu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>40p</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>mac99</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='riscv32'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='8'>spike</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='8'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='riscv64'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='8'>spike</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='8'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='s390x'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='sh4'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>shix</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>r2d</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='sh4eb'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>shix</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>r2d</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='sparc'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>LX</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='sparc64'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>niagara</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='x86_64'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>64</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='1'>isapc</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>microvm</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='kvm'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <acpi default='on' toggle='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:       <apic default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='xtensa'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>sim</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>kc705</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ml605</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx200</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx60</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]:   <guest>
Nov 15 01:09:39 user nova-compute[74880]:     <os_type>hvm</os_type>
Nov 15 01:09:39 user nova-compute[74880]:     <arch name='xtensaeb'>
Nov 15 01:09:39 user nova-compute[74880]:       <wordsize>32</wordsize>
Nov 15 01:09:39 user nova-compute[74880]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='4'>sim</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>kc705</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ml605</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>virt</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx200</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>lx60</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 01:09:39 user nova-compute[74880]:       <domain type='qemu'/>
Nov 15 01:09:39 user nova-compute[74880]:     </arch>
Nov 15 01:09:39 user nova-compute[74880]:     <features>
Nov 15 01:09:39 user nova-compute[74880]:       <cpuselection/>
Nov 15 01:09:39 user nova-compute[74880]:       <deviceboot/>
Nov 15 01:09:39 user nova-compute[74880]:       <disksnapshot default='on' toggle='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     </features>
Nov 15 01:09:39 user nova-compute[74880]:   </guest>
Nov 15 01:09:39 user nova-compute[74880]: </capabilities>
Nov 15 01:09:39 user nova-compute[74880]: 
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-q35-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>i686</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='288'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'/>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='lm'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-q35-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>i686</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='288'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'/>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='lm'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-i440fx-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>i686</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='255'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'/>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='lm'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ide</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-i440fx-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>i686</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='255'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'/>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='lm'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ide</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-q35-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>x86_64</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='288'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>efi</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='invtsc'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='rsba'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-q35-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>x86_64</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='288'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>efi</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='invtsc'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='rsba'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-i440fx-6.2</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>x86_64</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='255'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>efi</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='invtsc'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='rsba'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ide</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 01:09:39 user nova-compute[74880]: <domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 01:09:39 user nova-compute[74880]:   <domain>kvm</domain>
Nov 15 01:09:39 user nova-compute[74880]:   <machine>pc-i440fx-jammy</machine>
Nov 15 01:09:39 user nova-compute[74880]:   <arch>x86_64</arch>
Nov 15 01:09:39 user nova-compute[74880]:   <vcpu max='255'/>
Nov 15 01:09:39 user nova-compute[74880]:   <iothreads supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:   <os supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='firmware'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>efi</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:     <loader supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>rom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pflash</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='readonly'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>yes</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='secure'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>no</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </loader>
Nov 15 01:09:39 user nova-compute[74880]:   </os>
Nov 15 01:09:39 user nova-compute[74880]:   <cpu>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-passthrough' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='hostPassthroughMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='maximum' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='maximumMigratable'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>on</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>off</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='host-model' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <vendor>Intel</vendor>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ss'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='vmx'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pcid'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='hypervisor'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arat'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='umip'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='md-clear'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='invtsc'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibpb'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='ibrs'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-stibp'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='rsba'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='erms'/>
Nov 15 01:09:39 user nova-compute[74880]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:     <mode name='custom' supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>qemu64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>qemu32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>phenom</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>pentium</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>n270</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm64</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>kvm32</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>coreduo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>core2duo</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>athlon</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Westmere</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Snowridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Skylake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>SandyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Penryn</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G5</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G4</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G3</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Opteron_G2</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Opteron_G1</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>IvyBridge</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Icelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Haswell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Rome</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-Milan</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>EPYC</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Dhyana</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cooperlake</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>Conroe</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='no'>Broadwell</model>
Nov 15 01:09:39 user nova-compute[74880]:       <model usable='yes'>486</model>
Nov 15 01:09:39 user nova-compute[74880]:     </mode>
Nov 15 01:09:39 user nova-compute[74880]:   </cpu>
Nov 15 01:09:39 user nova-compute[74880]:   <memoryBacking supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:     <enum name='sourceType'>
Nov 15 01:09:39 user nova-compute[74880]:       <value>file</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>anonymous</value>
Nov 15 01:09:39 user nova-compute[74880]:       <value>memfd</value>
Nov 15 01:09:39 user nova-compute[74880]:     </enum>
Nov 15 01:09:39 user nova-compute[74880]:   </memoryBacking>
Nov 15 01:09:39 user nova-compute[74880]:   <devices>
Nov 15 01:09:39 user nova-compute[74880]:     <disk supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='diskDevice'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>disk</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cdrom</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>floppy</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>lun</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='bus'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ide</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>fdc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sata</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </disk>
Nov 15 01:09:39 user nova-compute[74880]:     <graphics supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='type'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>sdl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vnc</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>spice</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egl-headless</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </graphics>
Nov 15 01:09:39 user nova-compute[74880]:     <video supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='modelType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>cirrus</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>vmvga</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>qxl</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>none</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>bochs</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>ramfb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </video>
Nov 15 01:09:39 user nova-compute[74880]:     <hostdev supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='mode'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>subsystem</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='startupPolicy'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>default</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>mandatory</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>requisite</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>optional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='subsysType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>usb</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>pci</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>scsi</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='capsType'/>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='pciBackend'/>
Nov 15 01:09:39 user nova-compute[74880]:     </hostdev>
Nov 15 01:09:39 user nova-compute[74880]:     <rng supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtio-non-transitional</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>random</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>egd</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>builtin</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </rng>
Nov 15 01:09:39 user nova-compute[74880]:     <filesystem supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='driverType'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>path</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>handle</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>virtiofs</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </filesystem>
Nov 15 01:09:39 user nova-compute[74880]:     <tpm supported='yes'>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='model'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-tis</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>tpm-crb</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:       <enum name='backendModel'>
Nov 15 01:09:39 user nova-compute[74880]:         <value>passthrough</value>
Nov 15 01:09:39 user nova-compute[74880]:         <value>emulator</value>
Nov 15 01:09:39 user nova-compute[74880]:       </enum>
Nov 15 01:09:39 user nova-compute[74880]:     </tpm>
Nov 15 01:09:39 user nova-compute[74880]:   </devices>
Nov 15 01:09:39 user nova-compute[74880]:   <features>
Nov 15 01:09:39 user nova-compute[74880]:     <gic supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:     <vmcoreinfo supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <genid supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backingStoreInput supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <backup supported='yes'/>
Nov 15 01:09:39 user nova-compute[74880]:     <sev supported='no'/>
Nov 15 01:09:39 user nova-compute[74880]:   </features>
Nov 15 01:09:39 user nova-compute[74880]: </domainCapabilities>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74880) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74880) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Checking secure boot support for host arch (x86_64) {{(pid=74880) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 01:09:39 user nova-compute[74880]: INFO nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Secure Boot support detected
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] cpu compare xml: <cpu match="exact">
Nov 15 01:09:39 user nova-compute[74880]:   <model>Nehalem</model>
Nov 15 01:09:39 user nova-compute[74880]: </cpu>
Nov 15 01:09:39 user nova-compute[74880]:  {{(pid=74880) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 01:09:39 user nova-compute[74880]: INFO nova.virt.node [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Generated node identity 51756651-d511-4749-8c0a-4c67c2051bce
Nov 15 01:09:39 user nova-compute[74880]: INFO nova.virt.node [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Wrote node identity 51756651-d511-4749-8c0a-4c67c2051bce to /opt/stack/data/nova/compute_id
Nov 15 01:09:39 user nova-compute[74880]: WARNING nova.compute.manager [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Compute nodes ['51756651-d511-4749-8c0a-4c67c2051bce'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 01:09:39 user nova-compute[74880]: INFO nova.compute.manager [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 01:09:39 user nova-compute[74880]: WARNING nova.compute.manager [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 01:09:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:09:39 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:09:39 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:09:39 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Hypervisor/Node resource view: name=user free_ram=10936MB free_disk=26.326602935791016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:09:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:09:39 user nova-compute[74880]: WARNING nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] No compute node record for user:51756651-d511-4749-8c0a-4c67c2051bce: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 51756651-d511-4749-8c0a-4c67c2051bce could not be found.
Nov 15 01:09:39 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Compute node record created for user:user with uuid: 51756651-d511-4749-8c0a-4c67c2051bce
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:09:40 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] [req-3d99a498-9bfe-49e1-9fa0-b92fd7193d6f] Created resource provider record via placement API for resource provider with UUID 51756651-d511-4749-8c0a-4c67c2051bce and name user.
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74880) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 01:09:40 user nova-compute[74880]: INFO nova.virt.libvirt.host [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] kernel doesn't support AMD SEV
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Libvirt baseline CPU <cpu>
Nov 15 01:09:40 user nova-compute[74880]:   <arch>x86_64</arch>
Nov 15 01:09:40 user nova-compute[74880]:   <model>Nehalem</model>
Nov 15 01:09:40 user nova-compute[74880]:   <vendor>Intel</vendor>
Nov 15 01:09:40 user nova-compute[74880]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 01:09:40 user nova-compute[74880]: </cpu>
Nov 15 01:09:40 user nova-compute[74880]:  {{(pid=74880) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Updated inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Updating resource provider 51756651-d511-4749-8c0a-4c67c2051bce generation from 0 to 1 during operation: update_inventory {{(pid=74880) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Updating resource provider 51756651-d511-4749-8c0a-4c67c2051bce generation from 1 to 2 during operation: update_traits {{(pid=74880) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.service [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Creating RPC server for service compute {{(pid=74880) start /opt/stack/nova/nova/service.py:182}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.service [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] Join ServiceGroup membership for this service compute {{(pid=74880) start /opt/stack/nova/nova/service.py:199}}
Nov 15 01:09:40 user nova-compute[74880]: DEBUG nova.servicegroup.drivers.db [None req-2b3c0bb8-0af4-49f7-8d08-1083f9989413 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74880) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 01:10:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:10:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:10:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:10:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:10:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=10383MB free_disk=26.230499267578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:10:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:11:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:11:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=10285MB free_disk=26.29509735107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:11:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:11:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:12:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:12:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:12:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:12:32 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:12:33 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:12:33 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:12:33 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=10294MB free_disk=26.047245025634766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:12:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:12:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:12:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:12:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:13:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:13:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:13:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:33 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:33 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:34 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:13:35 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:35 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:35 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9586MB free_disk=26.066692352294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:13:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:13:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:13:37 user nova-compute[74880]: INFO nova.compute.claims [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Claim successful on node user
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:13:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:13:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:13:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:13:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Creating image(s)
Nov 15 01:13:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:38 user nova-compute[74880]: DEBUG nova.policy [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c88b23d691c4cdc98757d0af8ab27c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96e59bffc2b4c99940e4c87ad82521e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.part --force-share --output=json" returned: 0 in 0.159s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG nova.virt.images [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] 9e9b279c-74a4-42a5-b459-aec607e3df19 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.part /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.part /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.converted" returned: 0 in 0.325s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.321s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:39 user nova-compute[74880]: INFO oslo.privsep.daemon [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu530bpdj/privsep.sock']
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:39 user sudo[84142]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu530bpdj/privsep.sock
Nov 15 01:13:39 user sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 01:13:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:13:39 user nova-compute[74880]: INFO nova.compute.claims [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Claim successful on node user
Nov 15 01:13:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:39 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.350s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:13:40 user nova-compute[74880]: INFO nova.compute.claims [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Claim successful on node user
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:13:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.policy [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c88b23d691c4cdc98757d0af8ab27c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96e59bffc2b4c99940e4c87ad82521e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:13:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Creating image(s)
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:13:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:13:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Creating image(s)
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "/opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "/opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "/opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:40 user nova-compute[74880]: DEBUG nova.policy [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9de13732bcf04ab98686accb51cd4af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b89fc20cea474b93164a63cbc4c3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:13:41 user sudo[84142]: pam_unix(sudo:session): session closed for user root
Nov 15 01:13:41 user nova-compute[74880]: INFO oslo.privsep.daemon [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Spawned new privsep daemon via rootwrap
Nov 15 01:13:41 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 01:13:41 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 01:13:41 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 01:13:41 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84150
Nov 15 01:13:41 user nova-compute[74880]: WARNING oslo_privsep.priv_context [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] privsep daemon already running
Nov 15 01:13:41 user nova-compute[74880]: WARNING oslo_privsep.priv_context [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] privsep daemon already running
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Successfully created port: 425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk 1073741824" returned: 0 in 0.048s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.262s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.206s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk 1073741824" returned: 0 in 0.043s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.489s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Cannot resize image /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Ensure instance console log exists: /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk 1073741824" returned: 0 in 0.043s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Cannot resize image /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Ensure instance console log exists: /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Cannot resize image /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Ensure instance console log exists: /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:42 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Successfully created port: e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:13:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Successfully created port: d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:13:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Successfully updated port: 425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:13:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-changed-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Refreshing instance network info cache due to event network-changed-425e2abd-4b97-45d3-bf1d-83aee8ad920d. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Successfully updated port: e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:13:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance network_info: |[{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Refreshing network info cache for port 425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Start _get_guest_xml network_info=[{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:13:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1651043979',display_name='tempest-ServerRescueNegativeTestJSON-server-1651043979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1651043979',id=1,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-9rf0n0nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:38Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'pci_devices' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-changed-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Refreshing instance network info cache due to event network-changed-e9b027ca-99e0-44f7-9658-785628855901. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] Acquiring lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:13:45 user nova-compute[74880]:   <uuid>67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0</uuid>
Nov 15 01:13:45 user nova-compute[74880]:   <name>instance-00000001</name>
Nov 15 01:13:45 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:13:45 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:13:45 user nova-compute[74880]:   <metadata>
Nov 15 01:13:45 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:13:45 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:13:45 user nova-compute[74880]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1651043979</nova:name>
Nov 15 01:13:45 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:13:45</nova:creationTime>
Nov 15 01:13:45 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:13:45 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:13:45 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:13:45 user nova-compute[74880]:       <nova:owner>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:user uuid="7c88b23d691c4cdc98757d0af8ab27c1">tempest-ServerRescueNegativeTestJSON-1212122190-project-member</nova:user>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:project uuid="d96e59bffc2b4c99940e4c87ad82521e">tempest-ServerRescueNegativeTestJSON-1212122190</nova:project>
Nov 15 01:13:45 user nova-compute[74880]:       </nova:owner>
Nov 15 01:13:45 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:13:45 user nova-compute[74880]:       <nova:ports>
Nov 15 01:13:45 user nova-compute[74880]:         <nova:port uuid="425e2abd-4b97-45d3-bf1d-83aee8ad920d">
Nov 15 01:13:45 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:13:45 user nova-compute[74880]:         </nova:port>
Nov 15 01:13:45 user nova-compute[74880]:       </nova:ports>
Nov 15 01:13:45 user nova-compute[74880]:     </nova:instance>
Nov 15 01:13:45 user nova-compute[74880]:   </metadata>
Nov 15 01:13:45 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:13:45 user nova-compute[74880]:     <system>
Nov 15 01:13:45 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:13:45 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:13:45 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:13:45 user nova-compute[74880]:       <entry name="serial">67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0</entry>
Nov 15 01:13:45 user nova-compute[74880]:       <entry name="uuid">67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0</entry>
Nov 15 01:13:45 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:13:45 user nova-compute[74880]:     </system>
Nov 15 01:13:45 user nova-compute[74880]:   </sysinfo>
Nov 15 01:13:45 user nova-compute[74880]:   <os>
Nov 15 01:13:45 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:13:45 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:13:45 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:13:45 user nova-compute[74880]:   </os>
Nov 15 01:13:45 user nova-compute[74880]:   <features>
Nov 15 01:13:45 user nova-compute[74880]:     <acpi/>
Nov 15 01:13:45 user nova-compute[74880]:     <apic/>
Nov 15 01:13:45 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:13:45 user nova-compute[74880]:   </features>
Nov 15 01:13:45 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:13:45 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:13:45 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:13:45 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:13:45 user nova-compute[74880]:   </clock>
Nov 15 01:13:45 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:13:45 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:13:45 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:13:45 user nova-compute[74880]:   </cpu>
Nov 15 01:13:45 user nova-compute[74880]:   <devices>
Nov 15 01:13:45 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:13:45 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:13:45 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk"/>
Nov 15 01:13:45 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:13:45 user nova-compute[74880]:     </disk>
Nov 15 01:13:45 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:13:45 user nova-compute[74880]:       <mac address="fa:16:3e:ba:aa:8e"/>
Nov 15 01:13:45 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:45 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:13:45 user nova-compute[74880]:       <target dev="tap425e2abd-4b"/>
Nov 15 01:13:45 user nova-compute[74880]:     </interface>
Nov 15 01:13:45 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:13:45 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/console.log" append="off"/>
Nov 15 01:13:45 user nova-compute[74880]:     </serial>
Nov 15 01:13:45 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:13:45 user nova-compute[74880]:     <video>
Nov 15 01:13:45 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:45 user nova-compute[74880]:     </video>
Nov 15 01:13:45 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:13:45 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:13:45 user nova-compute[74880]:     </rng>
Nov 15 01:13:45 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:13:45 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:13:45 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:13:45 user nova-compute[74880]:     </memballoon>
Nov 15 01:13:45 user nova-compute[74880]:   </devices>
Nov 15 01:13:45 user nova-compute[74880]: </domain>
Nov 15 01:13:45 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1651043979',display_name='tempest-ServerRescueNegativeTestJSON-server-1651043979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1651043979',id=1,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-9rf0n0nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:38Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG os_vif [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Created schema index Interface.name {{(pid=74880) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Created schema index Port.name {{(pid=74880) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Created schema index Bridge.name {{(pid=74880) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [POLLOUT] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39f67316-7b06-5267-9b5e-a3448a37ca09', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: INFO oslo.privsep.daemon [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmptihiqi0c/privsep.sock']
Nov 15 01:13:45 user sudo[84199]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmptihiqi0c/privsep.sock
Nov 15 01:13:45 user sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 01:13:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Successfully updated port: d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquired lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.neutron [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.neutron [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updated VIF entry in instance network info cache for port 425e2abd-4b97-45d3-bf1d-83aee8ad920d. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.neutron [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e9e53b4-24a8-4dac-a3ad-015a2070ee11 req-81fa69bb-cd6b-4465-a662-c3640289dece service nova] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance network_info: |[{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] Acquired lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.neutron [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Refreshing network info cache for port e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Start _get_guest_xml network_info=[{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:13:46 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:46 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737312131',display_name='tempest-ServerRescueNegativeTestJSON-server-1737312131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737312131',id=2,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-ja26cgna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:40Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=fc9fe17c-b782-44d0-8adc-3c42fde5af94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:13:46 user nova-compute[74880]:   <uuid>fc9fe17c-b782-44d0-8adc-3c42fde5af94</uuid>
Nov 15 01:13:46 user nova-compute[74880]:   <name>instance-00000002</name>
Nov 15 01:13:46 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:13:46 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:13:46 user nova-compute[74880]:   <metadata>
Nov 15 01:13:46 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:13:46 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:13:46 user nova-compute[74880]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1737312131</nova:name>
Nov 15 01:13:46 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:13:46</nova:creationTime>
Nov 15 01:13:46 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:13:46 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:13:46 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:13:46 user nova-compute[74880]:       <nova:owner>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:user uuid="7c88b23d691c4cdc98757d0af8ab27c1">tempest-ServerRescueNegativeTestJSON-1212122190-project-member</nova:user>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:project uuid="d96e59bffc2b4c99940e4c87ad82521e">tempest-ServerRescueNegativeTestJSON-1212122190</nova:project>
Nov 15 01:13:46 user nova-compute[74880]:       </nova:owner>
Nov 15 01:13:46 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:13:46 user nova-compute[74880]:       <nova:ports>
Nov 15 01:13:46 user nova-compute[74880]:         <nova:port uuid="e9b027ca-99e0-44f7-9658-785628855901">
Nov 15 01:13:46 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:13:46 user nova-compute[74880]:         </nova:port>
Nov 15 01:13:46 user nova-compute[74880]:       </nova:ports>
Nov 15 01:13:46 user nova-compute[74880]:     </nova:instance>
Nov 15 01:13:46 user nova-compute[74880]:   </metadata>
Nov 15 01:13:46 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:13:46 user nova-compute[74880]:     <system>
Nov 15 01:13:46 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:13:46 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:13:46 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:13:46 user nova-compute[74880]:       <entry name="serial">fc9fe17c-b782-44d0-8adc-3c42fde5af94</entry>
Nov 15 01:13:46 user nova-compute[74880]:       <entry name="uuid">fc9fe17c-b782-44d0-8adc-3c42fde5af94</entry>
Nov 15 01:13:46 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:13:46 user nova-compute[74880]:     </system>
Nov 15 01:13:46 user nova-compute[74880]:   </sysinfo>
Nov 15 01:13:46 user nova-compute[74880]:   <os>
Nov 15 01:13:46 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:13:46 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:13:46 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:13:46 user nova-compute[74880]:   </os>
Nov 15 01:13:46 user nova-compute[74880]:   <features>
Nov 15 01:13:46 user nova-compute[74880]:     <acpi/>
Nov 15 01:13:46 user nova-compute[74880]:     <apic/>
Nov 15 01:13:46 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:13:46 user nova-compute[74880]:   </features>
Nov 15 01:13:46 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:13:46 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:13:46 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:13:46 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:13:46 user nova-compute[74880]:   </clock>
Nov 15 01:13:46 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:13:46 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:13:46 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:13:46 user nova-compute[74880]:   </cpu>
Nov 15 01:13:46 user nova-compute[74880]:   <devices>
Nov 15 01:13:46 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:13:46 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:13:46 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk"/>
Nov 15 01:13:46 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:13:46 user nova-compute[74880]:     </disk>
Nov 15 01:13:46 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:13:46 user nova-compute[74880]:       <mac address="fa:16:3e:87:e8:d3"/>
Nov 15 01:13:46 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:46 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:13:46 user nova-compute[74880]:       <target dev="tape9b027ca-99"/>
Nov 15 01:13:46 user nova-compute[74880]:     </interface>
Nov 15 01:13:46 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:13:46 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/console.log" append="off"/>
Nov 15 01:13:46 user nova-compute[74880]:     </serial>
Nov 15 01:13:46 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:13:46 user nova-compute[74880]:     <video>
Nov 15 01:13:46 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:46 user nova-compute[74880]:     </video>
Nov 15 01:13:46 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:13:46 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:13:46 user nova-compute[74880]:     </rng>
Nov 15 01:13:46 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:13:46 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:13:46 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:13:46 user nova-compute[74880]:     </memballoon>
Nov 15 01:13:46 user nova-compute[74880]:   </devices>
Nov 15 01:13:46 user nova-compute[74880]: </domain>
Nov 15 01:13:46 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737312131',display_name='tempest-ServerRescueNegativeTestJSON-server-1737312131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737312131',id=2,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-ja26cgna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:40Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=fc9fe17c-b782-44d0-8adc-3c42fde5af94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG os_vif [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '372ffc7c-8a1c-5150-99bc-3e1c15ec4ef6', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:13:46 user nova-compute[74880]: INFO nova.compute.claims [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Claim successful on node user
Nov 15 01:13:46 user sudo[84199]: pam_unix(sudo:session): session closed for user root
Nov 15 01:13:46 user nova-compute[74880]: INFO oslo.privsep.daemon [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Spawned new privsep daemon via rootwrap
Nov 15 01:13:46 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 01:13:46 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 01:13:46 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 01:13:46 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84207
Nov 15 01:13:46 user nova-compute[74880]: WARNING oslo_privsep.priv_context [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] privsep daemon already running
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Updating instance_info_cache with network_info: [{"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Releasing lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Instance network_info: |[{"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Start _get_guest_xml network_info=[{"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:13:47 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:47 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248536215',display_name='tempest-ServersNegativeTestJSON-server-248536215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248536215',id=3,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b89fc20cea474b93164a63cbc4c3e4',ramdisk_id='',reservation_id='r-azwpgb1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657617311',owner_user_name='tempest-ServersNegativeTestJSON-1657617311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:41Z,user_data=None,user_id='9de13732bcf04ab98686accb51cd4af4',uuid=2727cc6a-7997-41e6-aaa1-39bce8afdee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converting VIF {"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.objects.instance [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lazy-loading 'pci_devices' on Instance uuid 2727cc6a-7997-41e6-aaa1-39bce8afdee1 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:13:47 user nova-compute[74880]:   <uuid>2727cc6a-7997-41e6-aaa1-39bce8afdee1</uuid>
Nov 15 01:13:47 user nova-compute[74880]:   <name>instance-00000003</name>
Nov 15 01:13:47 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:13:47 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:13:47 user nova-compute[74880]:   <metadata>
Nov 15 01:13:47 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:13:47 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:13:47 user nova-compute[74880]:       <nova:name>tempest-ServersNegativeTestJSON-server-248536215</nova:name>
Nov 15 01:13:47 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:13:47</nova:creationTime>
Nov 15 01:13:47 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:13:47 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:13:47 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:13:47 user nova-compute[74880]:       <nova:owner>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:user uuid="9de13732bcf04ab98686accb51cd4af4">tempest-ServersNegativeTestJSON-1657617311-project-member</nova:user>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:project uuid="20b89fc20cea474b93164a63cbc4c3e4">tempest-ServersNegativeTestJSON-1657617311</nova:project>
Nov 15 01:13:47 user nova-compute[74880]:       </nova:owner>
Nov 15 01:13:47 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:13:47 user nova-compute[74880]:       <nova:ports>
Nov 15 01:13:47 user nova-compute[74880]:         <nova:port uuid="d3e13360-c31b-407b-9c14-2d1e76d74e46">
Nov 15 01:13:47 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 01:13:47 user nova-compute[74880]:         </nova:port>
Nov 15 01:13:47 user nova-compute[74880]:       </nova:ports>
Nov 15 01:13:47 user nova-compute[74880]:     </nova:instance>
Nov 15 01:13:47 user nova-compute[74880]:   </metadata>
Nov 15 01:13:47 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:13:47 user nova-compute[74880]:     <system>
Nov 15 01:13:47 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:13:47 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:13:47 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:13:47 user nova-compute[74880]:       <entry name="serial">2727cc6a-7997-41e6-aaa1-39bce8afdee1</entry>
Nov 15 01:13:47 user nova-compute[74880]:       <entry name="uuid">2727cc6a-7997-41e6-aaa1-39bce8afdee1</entry>
Nov 15 01:13:47 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:13:47 user nova-compute[74880]:     </system>
Nov 15 01:13:47 user nova-compute[74880]:   </sysinfo>
Nov 15 01:13:47 user nova-compute[74880]:   <os>
Nov 15 01:13:47 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:13:47 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:13:47 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:13:47 user nova-compute[74880]:   </os>
Nov 15 01:13:47 user nova-compute[74880]:   <features>
Nov 15 01:13:47 user nova-compute[74880]:     <acpi/>
Nov 15 01:13:47 user nova-compute[74880]:     <apic/>
Nov 15 01:13:47 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:13:47 user nova-compute[74880]:   </features>
Nov 15 01:13:47 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:13:47 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:13:47 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:13:47 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:13:47 user nova-compute[74880]:   </clock>
Nov 15 01:13:47 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:13:47 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:13:47 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:13:47 user nova-compute[74880]:   </cpu>
Nov 15 01:13:47 user nova-compute[74880]:   <devices>
Nov 15 01:13:47 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:13:47 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:13:47 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk"/>
Nov 15 01:13:47 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:13:47 user nova-compute[74880]:     </disk>
Nov 15 01:13:47 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:13:47 user nova-compute[74880]:       <mac address="fa:16:3e:11:23:c3"/>
Nov 15 01:13:47 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:47 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:13:47 user nova-compute[74880]:       <target dev="tapd3e13360-c3"/>
Nov 15 01:13:47 user nova-compute[74880]:     </interface>
Nov 15 01:13:47 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:13:47 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/console.log" append="off"/>
Nov 15 01:13:47 user nova-compute[74880]:     </serial>
Nov 15 01:13:47 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:13:47 user nova-compute[74880]:     <video>
Nov 15 01:13:47 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:47 user nova-compute[74880]:     </video>
Nov 15 01:13:47 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:13:47 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:13:47 user nova-compute[74880]:     </rng>
Nov 15 01:13:47 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:13:47 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:13:47 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:13:47 user nova-compute[74880]:     </memballoon>
Nov 15 01:13:47 user nova-compute[74880]:   </devices>
Nov 15 01:13:47 user nova-compute[74880]: </domain>
Nov 15 01:13:47 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248536215',display_name='tempest-ServersNegativeTestJSON-server-248536215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248536215',id=3,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b89fc20cea474b93164a63cbc4c3e4',ramdisk_id='',reservation_id='r-azwpgb1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657617311',owner_user_name='tempest-ServersNegativeTestJSON-1657617311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:41Z,user_data=None,user_id='9de13732bcf04ab98686accb51cd4af4',uuid=2727cc6a-7997-41e6-aaa1-39bce8afdee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converting VIF {"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG os_vif [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f7e715a-ffcf-5b62-90eb-72024df1963b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-changed-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Refreshing instance network info cache due to event network-changed-d3e13360-c31b-407b-9c14-2d1e76d74e46. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] Acquiring lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] Acquired lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Refreshing network info cache for port d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:13:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap425e2abd-4b, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap425e2abd-4b, col_values=(('qos', UUID('64141296-05a5-442b-9249-828d460b04ca')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap425e2abd-4b, col_values=(('external_ids', {'iface-id': '425e2abd-4b97-45d3-bf1d-83aee8ad920d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:aa:8e', 'vm-uuid': '67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: INFO os_vif [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b')
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b027ca-99, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9b027ca-99, col_values=(('qos', UUID('36e3f389-e55c-47f8-8838-a821f811d505')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9b027ca-99, col_values=(('external_ids', {'iface-id': 'e9b027ca-99e0-44f7-9658-785628855901', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:e8:d3', 'vm-uuid': 'fc9fe17c-b782-44d0-8adc-3c42fde5af94'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: INFO os_vif [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99')
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3e13360-c3, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3e13360-c3, col_values=(('qos', UUID('878170bf-59ac-463b-a563-3c041d052406')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3e13360-c3, col_values=(('external_ids', {'iface-id': 'd3e13360-c31b-407b-9c14-2d1e76d74e46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:23:c3', 'vm-uuid': '2727cc6a-7997-41e6-aaa1-39bce8afdee1'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.policy [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '403f23eeef274791a992f05e07b272b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4176dcde484c0d865259c76ca9f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:13:47 user nova-compute[74880]: INFO os_vif [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3')
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:ba:aa:8e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:87:e8:d3, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:13:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Creating image(s)
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] No VIF found with MAC fa:16:3e:11:23:c3, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updated VIF entry in instance network info cache for port e9b027ca-99e0-44f7-9658-785628855901. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:13:48 user nova-compute[74880]: INFO nova.compute.claims [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Claim successful on node user
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2d4a1088-3708-4082-a232-4657dfaf82d9 req-de3332f2-a3c9-4a5b-bffc-e140d1e26766 service nova] Releasing lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.152s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk 1073741824" returned: 0 in 0.053s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Updated VIF entry in instance network info cache for port d3e13360-c31b-407b-9c14-2d1e76d74e46. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Updating instance_info_cache with network_info: [{"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-56c29784-a0e1-4ca4-ac5b-90d7d4d697c7 req-dd190984-8223-48d3-a297-6ad3b86417cb service nova] Releasing lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Cannot resize image /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Ensure instance console log exists: /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:48 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.policy [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b04e9fd63942fb9279c26ddeec3acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3350f1780d5464dae7c3eca61375446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:13:48 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Creating image(s)
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "/opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "/opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.165s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk 1073741824" returned: 0 in 0.046s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.162s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Cannot resize image /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Ensure instance console log exists: /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Successfully created port: 9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:13:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:50 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Successfully created port: dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:13:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Successfully updated port: 9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing instance network info cache due to event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG nova.network.neutron [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:51 user nova-compute[74880]: DEBUG nova.network.neutron [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-942a4292-32f6-4e1c-b014-19ddd1d4fd75 req-64642d65-3d66-471b-963c-c9c72364a80c service nova] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Successfully updated port: dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance network_info: |[{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Start _get_guest_xml network_info=[{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-changed-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Refreshing instance network info cache due to event network-changed-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:13:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450655807',display_name='tempest-ServerStableDeviceRescueTest-server-450655807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450655807',id=4,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwrMEmNQ+OaLi5r3RGsdmAtnyiEwn6jhXz3iS4rtV/A0KBwCaS4ZTGXRJOA4jmkHs5PWFr+TFCwFtoDdgR5ofHFaKv0cilr24NRRQIMilzrnFRuY0t/mMgCD9nTrkR+zg==',key_name='tempest-keypair-2106614665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4176dcde484c0d865259c76ca9f617',ramdisk_id='',reservation_id='r-4jzevtae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-201731109',owner_user_name='tempest-ServerStableDeviceRescueTest-201731109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403f23eeef274791a992f05e07b272b7',uuid=3afca469-a0b7-4b07-a28a-ead0e367761e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converting VIF {"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'pci_devices' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:13:53 user nova-compute[74880]:   <uuid>3afca469-a0b7-4b07-a28a-ead0e367761e</uuid>
Nov 15 01:13:53 user nova-compute[74880]:   <name>instance-00000004</name>
Nov 15 01:13:53 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:13:53 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:13:53 user nova-compute[74880]:   <metadata>
Nov 15 01:13:53 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:13:53 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:13:53 user nova-compute[74880]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-450655807</nova:name>
Nov 15 01:13:53 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:13:53</nova:creationTime>
Nov 15 01:13:53 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:13:53 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:13:53 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:13:53 user nova-compute[74880]:       <nova:owner>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:user uuid="403f23eeef274791a992f05e07b272b7">tempest-ServerStableDeviceRescueTest-201731109-project-member</nova:user>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:project uuid="6f4176dcde484c0d865259c76ca9f617">tempest-ServerStableDeviceRescueTest-201731109</nova:project>
Nov 15 01:13:53 user nova-compute[74880]:       </nova:owner>
Nov 15 01:13:53 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:13:53 user nova-compute[74880]:       <nova:ports>
Nov 15 01:13:53 user nova-compute[74880]:         <nova:port uuid="9328a08d-3dad-4b21-9a7c-94361d28d20b">
Nov 15 01:13:53 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 01:13:53 user nova-compute[74880]:         </nova:port>
Nov 15 01:13:53 user nova-compute[74880]:       </nova:ports>
Nov 15 01:13:53 user nova-compute[74880]:     </nova:instance>
Nov 15 01:13:53 user nova-compute[74880]:   </metadata>
Nov 15 01:13:53 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:13:53 user nova-compute[74880]:     <system>
Nov 15 01:13:53 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:13:53 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:13:53 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:13:53 user nova-compute[74880]:       <entry name="serial">3afca469-a0b7-4b07-a28a-ead0e367761e</entry>
Nov 15 01:13:53 user nova-compute[74880]:       <entry name="uuid">3afca469-a0b7-4b07-a28a-ead0e367761e</entry>
Nov 15 01:13:53 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:13:53 user nova-compute[74880]:     </system>
Nov 15 01:13:53 user nova-compute[74880]:   </sysinfo>
Nov 15 01:13:53 user nova-compute[74880]:   <os>
Nov 15 01:13:53 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:13:53 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:13:53 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:13:53 user nova-compute[74880]:   </os>
Nov 15 01:13:53 user nova-compute[74880]:   <features>
Nov 15 01:13:53 user nova-compute[74880]:     <acpi/>
Nov 15 01:13:53 user nova-compute[74880]:     <apic/>
Nov 15 01:13:53 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:13:53 user nova-compute[74880]:   </features>
Nov 15 01:13:53 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:13:53 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:13:53 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:13:53 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:13:53 user nova-compute[74880]:   </clock>
Nov 15 01:13:53 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:13:53 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:13:53 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:13:53 user nova-compute[74880]:   </cpu>
Nov 15 01:13:53 user nova-compute[74880]:   <devices>
Nov 15 01:13:53 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:13:53 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:13:53 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk"/>
Nov 15 01:13:53 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:13:53 user nova-compute[74880]:     </disk>
Nov 15 01:13:53 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:13:53 user nova-compute[74880]:       <mac address="fa:16:3e:33:94:c9"/>
Nov 15 01:13:53 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:53 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:13:53 user nova-compute[74880]:       <target dev="tap9328a08d-3d"/>
Nov 15 01:13:53 user nova-compute[74880]:     </interface>
Nov 15 01:13:53 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:13:53 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/console.log" append="off"/>
Nov 15 01:13:53 user nova-compute[74880]:     </serial>
Nov 15 01:13:53 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:13:53 user nova-compute[74880]:     <video>
Nov 15 01:13:53 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:53 user nova-compute[74880]:     </video>
Nov 15 01:13:53 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:13:53 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:13:53 user nova-compute[74880]:     </rng>
Nov 15 01:13:53 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:13:53 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:13:53 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:13:53 user nova-compute[74880]:     </memballoon>
Nov 15 01:13:53 user nova-compute[74880]:   </devices>
Nov 15 01:13:53 user nova-compute[74880]: </domain>
Nov 15 01:13:53 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450655807',display_name='tempest-ServerStableDeviceRescueTest-server-450655807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450655807',id=4,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwrMEmNQ+OaLi5r3RGsdmAtnyiEwn6jhXz3iS4rtV/A0KBwCaS4ZTGXRJOA4jmkHs5PWFr+TFCwFtoDdgR5ofHFaKv0cilr24NRRQIMilzrnFRuY0t/mMgCD9nTrkR+zg==',key_name='tempest-keypair-2106614665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4176dcde484c0d865259c76ca9f617',ramdisk_id='',reservation_id='r-4jzevtae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-201731109',owner_user_name='tempest-ServerStableDeviceRescueTest-201731109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403f23eeef274791a992f05e07b272b7',uuid=3afca469-a0b7-4b07-a28a-ead0e367761e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converting VIF {"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG os_vif [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe33c980-efc2-5f07-9172-de985f94afd3', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9328a08d-3d, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9328a08d-3d, col_values=(('qos', UUID('d1407cc3-bbe7-4f00-bf36-c873cc622fcc')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9328a08d-3d, col_values=(('external_ids', {'iface-id': '9328a08d-3dad-4b21-9a7c-94361d28d20b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:94:c9', 'vm-uuid': '3afca469-a0b7-4b07-a28a-ead0e367761e'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:53 user nova-compute[74880]: INFO os_vif [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d')
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No VIF found with MAC fa:16:3e:33:94:c9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance spawned successfully.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance spawned successfully.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Instance spawned successfully.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Took 13.98 seconds to spawn the instance on the hypervisor.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Took 13.71 seconds to spawn the instance on the hypervisor.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Took 16.21 seconds to spawn the instance on the hypervisor.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Instance network_info: |[{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Refreshing network info cache for port dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Start _get_guest_xml network_info=[{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:13:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-409451842',display_name='tempest-ServerActionsTestOtherA-server-409451842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-409451842',id=5,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-1bdbu326',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=a3d02a78-a752-4ca5-ab3b-f45ada7a47e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'pci_devices' on Instance uuid a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:13:54 user nova-compute[74880]:   <uuid>a3d02a78-a752-4ca5-ab3b-f45ada7a47e7</uuid>
Nov 15 01:13:54 user nova-compute[74880]:   <name>instance-00000005</name>
Nov 15 01:13:54 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:13:54 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:13:54 user nova-compute[74880]:   <metadata>
Nov 15 01:13:54 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:13:54 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:13:54 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherA-server-409451842</nova:name>
Nov 15 01:13:54 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:13:54</nova:creationTime>
Nov 15 01:13:54 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:13:54 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:13:54 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:13:54 user nova-compute[74880]:       <nova:owner>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:user uuid="c0b04e9fd63942fb9279c26ddeec3acc">tempest-ServerActionsTestOtherA-1659960630-project-member</nova:user>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:project uuid="d3350f1780d5464dae7c3eca61375446">tempest-ServerActionsTestOtherA-1659960630</nova:project>
Nov 15 01:13:54 user nova-compute[74880]:       </nova:owner>
Nov 15 01:13:54 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:13:54 user nova-compute[74880]:       <nova:ports>
Nov 15 01:13:54 user nova-compute[74880]:         <nova:port uuid="dc4a6925-6a3f-47fc-a0df-0a77d9f5927b">
Nov 15 01:13:54 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:13:54 user nova-compute[74880]:         </nova:port>
Nov 15 01:13:54 user nova-compute[74880]:       </nova:ports>
Nov 15 01:13:54 user nova-compute[74880]:     </nova:instance>
Nov 15 01:13:54 user nova-compute[74880]:   </metadata>
Nov 15 01:13:54 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:13:54 user nova-compute[74880]:     <system>
Nov 15 01:13:54 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:13:54 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:13:54 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:13:54 user nova-compute[74880]:       <entry name="serial">a3d02a78-a752-4ca5-ab3b-f45ada7a47e7</entry>
Nov 15 01:13:54 user nova-compute[74880]:       <entry name="uuid">a3d02a78-a752-4ca5-ab3b-f45ada7a47e7</entry>
Nov 15 01:13:54 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:13:54 user nova-compute[74880]:     </system>
Nov 15 01:13:54 user nova-compute[74880]:   </sysinfo>
Nov 15 01:13:54 user nova-compute[74880]:   <os>
Nov 15 01:13:54 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:13:54 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:13:54 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:13:54 user nova-compute[74880]:   </os>
Nov 15 01:13:54 user nova-compute[74880]:   <features>
Nov 15 01:13:54 user nova-compute[74880]:     <acpi/>
Nov 15 01:13:54 user nova-compute[74880]:     <apic/>
Nov 15 01:13:54 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:13:54 user nova-compute[74880]:   </features>
Nov 15 01:13:54 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:13:54 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:13:54 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:13:54 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:13:54 user nova-compute[74880]:   </clock>
Nov 15 01:13:54 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:13:54 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:13:54 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:13:54 user nova-compute[74880]:   </cpu>
Nov 15 01:13:54 user nova-compute[74880]:   <devices>
Nov 15 01:13:54 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:13:54 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:13:54 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk"/>
Nov 15 01:13:54 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:13:54 user nova-compute[74880]:     </disk>
Nov 15 01:13:54 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:13:54 user nova-compute[74880]:       <mac address="fa:16:3e:de:40:96"/>
Nov 15 01:13:54 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:54 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:13:54 user nova-compute[74880]:       <target dev="tapdc4a6925-6a"/>
Nov 15 01:13:54 user nova-compute[74880]:     </interface>
Nov 15 01:13:54 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:13:54 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/console.log" append="off"/>
Nov 15 01:13:54 user nova-compute[74880]:     </serial>
Nov 15 01:13:54 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:13:54 user nova-compute[74880]:     <video>
Nov 15 01:13:54 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:13:54 user nova-compute[74880]:     </video>
Nov 15 01:13:54 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:13:54 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:13:54 user nova-compute[74880]:     </rng>
Nov 15 01:13:54 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:13:54 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:13:54 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:13:54 user nova-compute[74880]:     </memballoon>
Nov 15 01:13:54 user nova-compute[74880]:   </devices>
Nov 15 01:13:54 user nova-compute[74880]: </domain>
Nov 15 01:13:54 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-409451842',display_name='tempest-ServerActionsTestOtherA-server-409451842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-409451842',id=5,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-1bdbu326',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=a3d02a78-a752-4ca5-ab3b-f45ada7a47e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG os_vif [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.compute.manager [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Took 14.96 seconds to build instance.
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.compute.manager [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Took 14.96 seconds to build instance.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61f6185a-40b9-5cc3-b18b-5cad7ffc6851', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4a6925-6a, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc4a6925-6a, col_values=(('qos', UUID('90b5d62a-a095-43e8-b550-33d0c6aa2f73')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc4a6925-6a, col_values=(('external_ids', {'iface-id': 'dc4a6925-6a3f-47fc-a0df-0a77d9f5927b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:40:96', 'vm-uuid': 'a3d02a78-a752-4ca5-ab3b-f45ada7a47e7'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6735b90e-ffc7-43d3-bfe1-44dbef33c1f8 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.141s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: INFO os_vif [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a')
Nov 15 01:13:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb8786a5-7e66-4fcf-a53b-e5a5248891e5 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.200s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:54 user nova-compute[74880]: INFO nova.compute.manager [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Took 17.31 seconds to build instance.
Nov 15 01:13:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9cd26d84-2484-44e5-bbfb-799b12cbc3d1 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.667s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:13:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No VIF found with MAC fa:16:3e:de:40:96, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:13:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated VIF entry in instance network info cache for port dc4a6925-6a3f-47fc-a0df-0a77d9f5927b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:13:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:13:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-508043ed-c1e2-43ed-bd85-e65d1bcdbe3c req-f74623d1-37a8-4493-93f4-1d0561bb8179 service nova] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:13:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:13:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance spawned successfully.
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:13:59 user nova-compute[74880]: INFO nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Took 11.88 seconds to spawn the instance on the hypervisor.
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:13:59 user nova-compute[74880]: INFO nova.compute.manager [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Took 13.29 seconds to build instance.
Nov 15 01:13:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5261e92-4bb5-414b-88f3-e9fb90909571 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.424s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:13:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:00 user nova-compute[74880]: INFO nova.compute.claims [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Claim successful on node user
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:14:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Instance spawned successfully.
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:00 user nova-compute[74880]: INFO nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Took 11.71 seconds to spawn the instance on the hypervisor.
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:14:00 user nova-compute[74880]: INFO nova.compute.manager [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Took 12.67 seconds to build instance.
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7b04224e-81db-45a5-9dfe-68fa4e0195ea tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.888s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-8bff76e1-0645-407e-946f-d725517121b8 req-b78be40a-6033-4bc5-8e20-29fecd1997bd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8bff76e1-0645-407e-946f-d725517121b8 req-b78be40a-6033-4bc5-8e20-29fecd1997bd service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8bff76e1-0645-407e-946f-d725517121b8 req-b78be40a-6033-4bc5-8e20-29fecd1997bd service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8bff76e1-0645-407e-946f-d725517121b8 req-b78be40a-6033-4bc5-8e20-29fecd1997bd service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-8bff76e1-0645-407e-946f-d725517121b8 req-b78be40a-6033-4bc5-8e20-29fecd1997bd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:01 user nova-compute[74880]: WARNING nova.compute.manager [req-8bff76e1-0645-407e-946f-d725517121b8 req-b78be40a-6033-4bc5-8e20-29fecd1997bd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state active and task_state None.
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.policy [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54a257f03d0141539db26a7068a9abf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9de312532d4574b08130fdcecdaed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:14:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Creating image(s)
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "/opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "/opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.342s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.320s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk 1073741824" returned: 0 in 0.081s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.410s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.401s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Cannot resize image /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Ensure instance console log exists: /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Successfully created port: 904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:03 user nova-compute[74880]: WARNING nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state active and task_state None.
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] No waiting events found dispatching network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:03 user nova-compute[74880]: WARNING nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received unexpected event network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b for instance with vm_state active and task_state None.
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] No waiting events found dispatching network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:03 user nova-compute[74880]: WARNING nova.compute.manager [req-c75e01c2-419e-4ff6-96ce-c9cd005d4905 req-42d7d4a1-6ad2-4769-8e9b-084ff91e5de9 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received unexpected event network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b for instance with vm_state active and task_state None.
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-543cd245-c2af-41d5-b24e-767161089bc6 req-aa3b518e-0069-4414-81b5-d93c8291de79 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-543cd245-c2af-41d5-b24e-767161089bc6 req-aa3b518e-0069-4414-81b5-d93c8291de79 service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-543cd245-c2af-41d5-b24e-767161089bc6 req-aa3b518e-0069-4414-81b5-d93c8291de79 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-543cd245-c2af-41d5-b24e-767161089bc6 req-aa3b518e-0069-4414-81b5-d93c8291de79 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-543cd245-c2af-41d5-b24e-767161089bc6 req-aa3b518e-0069-4414-81b5-d93c8291de79 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:03 user nova-compute[74880]: WARNING nova.compute.manager [req-543cd245-c2af-41d5-b24e-767161089bc6 req-aa3b518e-0069-4414-81b5-d93c8291de79 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state active and task_state None.
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Successfully updated port: 904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquired lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-changed-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Refreshing instance network info cache due to event network-changed-904ecba4-3cc1-4872-9065-4b8923cdbc70. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] Acquiring lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updating instance_info_cache with network_info: [{"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Releasing lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Instance network_info: |[{"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] Acquired lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Refreshing network info cache for port 904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Start _get_guest_xml network_info=[{"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:14:05 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:05 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833915328',display_name='tempest-VolumesAdminNegativeTest-server-1833915328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833915328',id=6,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1pmKaEPDfYcZib+sRf+999hXHaR7udZ84EMcM8GJYa33D3xwC0MvSuE8kvbmldX7n4pMrJtaMhtqRNMymBTXBZ/vOtvq6kbv255lGxCXF9AtHmeR6LG+BL4kgNUSD5TQ==',key_name='tempest-keypair-733420488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb9de312532d4574b08130fdcecdaed2',ramdisk_id='',reservation_id='r-xt55znsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-325468300',owner_user_name='tempest-VolumesAdminNegativeTest-325468300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54a257f03d0141539db26a7068a9abf9',uuid=bc155ceb-d7ca-477b-8479-a459fa50af05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converting VIF {"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'pci_devices' on Instance uuid bc155ceb-d7ca-477b-8479-a459fa50af05 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:14:05 user nova-compute[74880]:   <uuid>bc155ceb-d7ca-477b-8479-a459fa50af05</uuid>
Nov 15 01:14:05 user nova-compute[74880]:   <name>instance-00000006</name>
Nov 15 01:14:05 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:14:05 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:14:05 user nova-compute[74880]:   <metadata>
Nov 15 01:14:05 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:14:05 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:14:05 user nova-compute[74880]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1833915328</nova:name>
Nov 15 01:14:05 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:14:05</nova:creationTime>
Nov 15 01:14:05 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:14:05 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:14:05 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:14:05 user nova-compute[74880]:       <nova:owner>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:user uuid="54a257f03d0141539db26a7068a9abf9">tempest-VolumesAdminNegativeTest-325468300-project-member</nova:user>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:project uuid="fb9de312532d4574b08130fdcecdaed2">tempest-VolumesAdminNegativeTest-325468300</nova:project>
Nov 15 01:14:05 user nova-compute[74880]:       </nova:owner>
Nov 15 01:14:05 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:14:05 user nova-compute[74880]:       <nova:ports>
Nov 15 01:14:05 user nova-compute[74880]:         <nova:port uuid="904ecba4-3cc1-4872-9065-4b8923cdbc70">
Nov 15 01:14:05 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:14:05 user nova-compute[74880]:         </nova:port>
Nov 15 01:14:05 user nova-compute[74880]:       </nova:ports>
Nov 15 01:14:05 user nova-compute[74880]:     </nova:instance>
Nov 15 01:14:05 user nova-compute[74880]:   </metadata>
Nov 15 01:14:05 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:14:05 user nova-compute[74880]:     <system>
Nov 15 01:14:05 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:14:05 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:14:05 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:14:05 user nova-compute[74880]:       <entry name="serial">bc155ceb-d7ca-477b-8479-a459fa50af05</entry>
Nov 15 01:14:05 user nova-compute[74880]:       <entry name="uuid">bc155ceb-d7ca-477b-8479-a459fa50af05</entry>
Nov 15 01:14:05 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:14:05 user nova-compute[74880]:     </system>
Nov 15 01:14:05 user nova-compute[74880]:   </sysinfo>
Nov 15 01:14:05 user nova-compute[74880]:   <os>
Nov 15 01:14:05 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:14:05 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:14:05 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:14:05 user nova-compute[74880]:   </os>
Nov 15 01:14:05 user nova-compute[74880]:   <features>
Nov 15 01:14:05 user nova-compute[74880]:     <acpi/>
Nov 15 01:14:05 user nova-compute[74880]:     <apic/>
Nov 15 01:14:05 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:14:05 user nova-compute[74880]:   </features>
Nov 15 01:14:05 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:14:05 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:14:05 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:14:05 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:14:05 user nova-compute[74880]:   </clock>
Nov 15 01:14:05 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:14:05 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:14:05 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:14:05 user nova-compute[74880]:   </cpu>
Nov 15 01:14:05 user nova-compute[74880]:   <devices>
Nov 15 01:14:05 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:14:05 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:14:05 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk"/>
Nov 15 01:14:05 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:14:05 user nova-compute[74880]:     </disk>
Nov 15 01:14:05 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:14:05 user nova-compute[74880]:       <mac address="fa:16:3e:e1:8f:93"/>
Nov 15 01:14:05 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:05 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:14:05 user nova-compute[74880]:       <target dev="tap904ecba4-3c"/>
Nov 15 01:14:05 user nova-compute[74880]:     </interface>
Nov 15 01:14:05 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:14:05 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/console.log" append="off"/>
Nov 15 01:14:05 user nova-compute[74880]:     </serial>
Nov 15 01:14:05 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:14:05 user nova-compute[74880]:     <video>
Nov 15 01:14:05 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:05 user nova-compute[74880]:     </video>
Nov 15 01:14:05 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:14:05 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:14:05 user nova-compute[74880]:     </rng>
Nov 15 01:14:05 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:14:05 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:14:05 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:14:05 user nova-compute[74880]:     </memballoon>
Nov 15 01:14:05 user nova-compute[74880]:   </devices>
Nov 15 01:14:05 user nova-compute[74880]: </domain>
Nov 15 01:14:05 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833915328',display_name='tempest-VolumesAdminNegativeTest-server-1833915328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833915328',id=6,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1pmKaEPDfYcZib+sRf+999hXHaR7udZ84EMcM8GJYa33D3xwC0MvSuE8kvbmldX7n4pMrJtaMhtqRNMymBTXBZ/vOtvq6kbv255lGxCXF9AtHmeR6LG+BL4kgNUSD5TQ==',key_name='tempest-keypair-733420488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb9de312532d4574b08130fdcecdaed2',ramdisk_id='',reservation_id='r-xt55znsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-325468300',owner_user_name='tempest-VolumesAdminNegativeTest-325468300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54a257f03d0141539db26a7068a9abf9',uuid=bc155ceb-d7ca-477b-8479-a459fa50af05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converting VIF {"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG os_vif [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b6c5f3c-af0d-5026-b2de-2293f52af097', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap904ecba4-3c, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap904ecba4-3c, col_values=(('qos', UUID('09c91961-01c8-4f2f-a8cd-d246a69e6d6b')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap904ecba4-3c, col_values=(('external_ids', {'iface-id': '904ecba4-3cc1-4872-9065-4b8923cdbc70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:8f:93', 'vm-uuid': 'bc155ceb-d7ca-477b-8479-a459fa50af05'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:05 user nova-compute[74880]: INFO os_vif [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c')
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No VIF found with MAC fa:16:3e:e1:8f:93, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-a36d8878-d48a-498f-a263-9bd6771c9409 req-5ca23828-e94e-4352-a3da-9d79ba3e7365 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a36d8878-d48a-498f-a263-9bd6771c9409 req-5ca23828-e94e-4352-a3da-9d79ba3e7365 service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a36d8878-d48a-498f-a263-9bd6771c9409 req-5ca23828-e94e-4352-a3da-9d79ba3e7365 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a36d8878-d48a-498f-a263-9bd6771c9409 req-5ca23828-e94e-4352-a3da-9d79ba3e7365 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-a36d8878-d48a-498f-a263-9bd6771c9409 req-5ca23828-e94e-4352-a3da-9d79ba3e7365 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:05 user nova-compute[74880]: WARNING nova.compute.manager [req-a36d8878-d48a-498f-a263-9bd6771c9409 req-5ca23828-e94e-4352-a3da-9d79ba3e7365 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state active and task_state None.
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updated VIF entry in instance network info cache for port 904ecba4-3cc1-4872-9065-4b8923cdbc70. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updating instance_info_cache with network_info: [{"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16bc9f64-e621-4877-a43f-74e2aebfd797 req-901a3e4a-b4a8-497b-b119-053fea56d3c0 service nova] Releasing lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:14:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:08 user nova-compute[74880]: INFO nova.compute.claims [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Claim successful on node user
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:09 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:14:09 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Creating image(s)
Nov 15 01:14:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "/opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "/opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "/opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "545cbd6338b38b801e89bf5065abc89cd8de72c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "545cbd6338b38b801e89bf5065abc89cd8de72c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:09 user nova-compute[74880]: DEBUG nova.policy [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '226080944cc547b089ec5ee30e804e10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f61ca3118144cba2be2c366b933e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Instance spawned successfully.
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:10 user nova-compute[74880]: INFO nova.compute.claims [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Claim successful on node user
Nov 15 01:14:10 user nova-compute[74880]: INFO nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Took 8.99 seconds to spawn the instance on the hypervisor.
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.part --force-share --output=json" returned: 0 in 0.289s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.virt.images [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] efbec64d-a83f-48c0-844e-e2740d5bbc31 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.part /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:10 user nova-compute[74880]: INFO nova.compute.manager [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Took 10.80 seconds to build instance.
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac2d7885-1ea7-4522-b171-04b6de7de5e6 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.015s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.part /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.converted" returned: 0 in 0.459s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3.converted --force-share --output=json" returned: 0 in 0.417s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "545cbd6338b38b801e89bf5065abc89cd8de72c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.861s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-299e4118-3add-45b1-998e-40e365808a54 req-6bdf22c7-8883-444d-b468-018f64b6ebab service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-299e4118-3add-45b1-998e-40e365808a54 req-6bdf22c7-8883-444d-b468-018f64b6ebab service nova] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-299e4118-3add-45b1-998e-40e365808a54 req-6bdf22c7-8883-444d-b468-018f64b6ebab service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-299e4118-3add-45b1-998e-40e365808a54 req-6bdf22c7-8883-444d-b468-018f64b6ebab service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-299e4118-3add-45b1-998e-40e365808a54 req-6bdf22c7-8883-444d-b468-018f64b6ebab service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] No waiting events found dispatching network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:11 user nova-compute[74880]: WARNING nova.compute.manager [req-299e4118-3add-45b1-998e-40e365808a54 req-6bdf22c7-8883-444d-b468-018f64b6ebab service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received unexpected event network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 for instance with vm_state active and task_state None.
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 --force-share --output=json" returned: 0 in 0.356s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "545cbd6338b38b801e89bf5065abc89cd8de72c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "545cbd6338b38b801e89bf5065abc89cd8de72c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.460s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Successfully created port: d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 --force-share --output=json" returned: 0 in 0.215s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3,backing_fmt=raw /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3,backing_fmt=raw /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk 1073741824" returned: 0 in 0.104s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "545cbd6338b38b801e89bf5065abc89cd8de72c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.policy [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f40427608ceb483da72faee674ab92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bb57a1bb274bbda3c9f0ffffc67762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Cannot resize image /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Ensure instance console log exists: /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:14:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Creating image(s)
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "/opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "/opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Successfully updated port: d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquired lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-changed-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Refreshing instance network info cache due to event network-changed-d9bef030-7b06-4058-ab38-ae84ea0f34d1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] Acquiring lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.311s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk 1073741824" returned: 0 in 0.085s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Successfully created port: f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updating instance_info_cache with network_info: [{"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Releasing lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Instance network_info: |[{"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] Acquired lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.neutron [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Refreshing network info cache for port d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Start _get_guest_xml network_info=[{"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:13:59Z,direct_url=<?>,disk_format='qcow2',id=efbec64d-a83f-48c0-844e-e2740d5bbc31,min_disk=0,min_ram=0,name='',owner='384fbf5ef13045c98e0ef4bcbe87932f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:14:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'efbec64d-a83f-48c0-844e-e2740d5bbc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:14:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-2ce8d445-777a-4f3e-8836-58869e818129 req-9ee17a37-4426-4e4f-95a1-76d707a09905 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2ce8d445-777a-4f3e-8836-58869e818129 req-9ee17a37-4426-4e4f-95a1-76d707a09905 service nova] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2ce8d445-777a-4f3e-8836-58869e818129 req-9ee17a37-4426-4e4f-95a1-76d707a09905 service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2ce8d445-777a-4f3e-8836-58869e818129 req-9ee17a37-4426-4e4f-95a1-76d707a09905 service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-2ce8d445-777a-4f3e-8836-58869e818129 req-9ee17a37-4426-4e4f-95a1-76d707a09905 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] No waiting events found dispatching network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:13 user nova-compute[74880]: WARNING nova.compute.manager [req-2ce8d445-777a-4f3e-8836-58869e818129 req-9ee17a37-4426-4e4f-95a1-76d707a09905 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received unexpected event network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 for instance with vm_state active and task_state None.
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:13:59Z,direct_url=<?>,disk_format='qcow2',id=efbec64d-a83f-48c0-844e-e2740d5bbc31,min_disk=0,min_ram=0,name='',owner='384fbf5ef13045c98e0ef4bcbe87932f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:14:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-10637562',display_name='tempest-AttachSCSIVolumeTestJSON-server-10637562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-10637562',id=7,image_ref='efbec64d-a83f-48c0-844e-e2740d5bbc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxKaPFs2y3FnNmqS8+sI0/Kt/K1Jkr4mNXqcNwnwyz8ktonFQ/nXyot/Zx0F3ZVJgLY7AWJBYjlB9YvYgajB1zM2311dlh9JJRiSNS90EJRZNckkNUIoFZiVINg692qhA==',key_name='tempest-keypair-58174793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f61ca3118144cba2be2c366b933e2d',ramdisk_id='',reservation_id='r-byhjnczx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efbec64d-a83f-48c0-844e-e2740d5bbc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1714219061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1714219061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='226080944cc547b089ec5ee30e804e10',uuid=9866d0ef-d713-4601-b797-780abd5fb7af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Converting VIF {"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lazy-loading 'pci_devices' on Instance uuid 9866d0ef-d713-4601-b797-780abd5fb7af {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:14:13 user nova-compute[74880]:   <uuid>9866d0ef-d713-4601-b797-780abd5fb7af</uuid>
Nov 15 01:14:13 user nova-compute[74880]:   <name>instance-00000007</name>
Nov 15 01:14:13 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:14:13 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:14:13 user nova-compute[74880]:   <metadata>
Nov 15 01:14:13 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:14:13 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:14:13 user nova-compute[74880]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-10637562</nova:name>
Nov 15 01:14:13 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:14:13</nova:creationTime>
Nov 15 01:14:13 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:14:13 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:14:13 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:14:13 user nova-compute[74880]:       <nova:owner>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:user uuid="226080944cc547b089ec5ee30e804e10">tempest-AttachSCSIVolumeTestJSON-1714219061-project-member</nova:user>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:project uuid="f7f61ca3118144cba2be2c366b933e2d">tempest-AttachSCSIVolumeTestJSON-1714219061</nova:project>
Nov 15 01:14:13 user nova-compute[74880]:       </nova:owner>
Nov 15 01:14:13 user nova-compute[74880]:       <nova:root type="image" uuid="efbec64d-a83f-48c0-844e-e2740d5bbc31"/>
Nov 15 01:14:13 user nova-compute[74880]:       <nova:ports>
Nov 15 01:14:13 user nova-compute[74880]:         <nova:port uuid="d9bef030-7b06-4058-ab38-ae84ea0f34d1">
Nov 15 01:14:13 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 01:14:13 user nova-compute[74880]:         </nova:port>
Nov 15 01:14:13 user nova-compute[74880]:       </nova:ports>
Nov 15 01:14:13 user nova-compute[74880]:     </nova:instance>
Nov 15 01:14:13 user nova-compute[74880]:   </metadata>
Nov 15 01:14:13 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:14:13 user nova-compute[74880]:     <system>
Nov 15 01:14:13 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:14:13 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:14:13 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:14:13 user nova-compute[74880]:       <entry name="serial">9866d0ef-d713-4601-b797-780abd5fb7af</entry>
Nov 15 01:14:13 user nova-compute[74880]:       <entry name="uuid">9866d0ef-d713-4601-b797-780abd5fb7af</entry>
Nov 15 01:14:13 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:14:13 user nova-compute[74880]:     </system>
Nov 15 01:14:13 user nova-compute[74880]:   </sysinfo>
Nov 15 01:14:13 user nova-compute[74880]:   <os>
Nov 15 01:14:13 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:14:13 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:14:13 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:14:13 user nova-compute[74880]:   </os>
Nov 15 01:14:13 user nova-compute[74880]:   <features>
Nov 15 01:14:13 user nova-compute[74880]:     <acpi/>
Nov 15 01:14:13 user nova-compute[74880]:     <apic/>
Nov 15 01:14:13 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:14:13 user nova-compute[74880]:   </features>
Nov 15 01:14:13 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:14:13 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:14:13 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:14:13 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:14:13 user nova-compute[74880]:   </clock>
Nov 15 01:14:13 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:14:13 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:14:13 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:14:13 user nova-compute[74880]:   </cpu>
Nov 15 01:14:13 user nova-compute[74880]:   <devices>
Nov 15 01:14:13 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:14:13 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:14:13 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk"/>
Nov 15 01:14:13 user nova-compute[74880]:       <target dev="sda" bus="scsi"/>
Nov 15 01:14:13 user nova-compute[74880]:       <address type="drive" controller="0" unit="0"/>
Nov 15 01:14:13 user nova-compute[74880]:     </disk>
Nov 15 01:14:13 user nova-compute[74880]:     <disk type="file" device="cdrom">
Nov 15 01:14:13 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 01:14:13 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.config"/>
Nov 15 01:14:13 user nova-compute[74880]:       <target dev="sdb" bus="scsi"/>
Nov 15 01:14:13 user nova-compute[74880]:       <address type="drive" controller="0" unit="1"/>
Nov 15 01:14:13 user nova-compute[74880]:     </disk>
Nov 15 01:14:13 user nova-compute[74880]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 01:14:13 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:14:13 user nova-compute[74880]:       <mac address="fa:16:3e:03:38:a5"/>
Nov 15 01:14:13 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:13 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:14:13 user nova-compute[74880]:       <target dev="tapd9bef030-7b"/>
Nov 15 01:14:13 user nova-compute[74880]:     </interface>
Nov 15 01:14:13 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:14:13 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/console.log" append="off"/>
Nov 15 01:14:13 user nova-compute[74880]:     </serial>
Nov 15 01:14:13 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:14:13 user nova-compute[74880]:     <video>
Nov 15 01:14:13 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:13 user nova-compute[74880]:     </video>
Nov 15 01:14:13 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:14:13 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:14:13 user nova-compute[74880]:     </rng>
Nov 15 01:14:13 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:14:13 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:14:13 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:14:13 user nova-compute[74880]:     </memballoon>
Nov 15 01:14:13 user nova-compute[74880]:   </devices>
Nov 15 01:14:13 user nova-compute[74880]: </domain>
Nov 15 01:14:13 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-10637562',display_name='tempest-AttachSCSIVolumeTestJSON-server-10637562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-10637562',id=7,image_ref='efbec64d-a83f-48c0-844e-e2740d5bbc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxKaPFs2y3FnNmqS8+sI0/Kt/K1Jkr4mNXqcNwnwyz8ktonFQ/nXyot/Zx0F3ZVJgLY7AWJBYjlB9YvYgajB1zM2311dlh9JJRiSNS90EJRZNckkNUIoFZiVINg692qhA==',key_name='tempest-keypair-58174793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f61ca3118144cba2be2c366b933e2d',ramdisk_id='',reservation_id='r-byhjnczx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efbec64d-a83f-48c0-844e-e2740d5bbc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1714219061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1714219061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='226080944cc547b089ec5ee30e804e10',uuid=9866d0ef-d713-4601-b797-780abd5fb7af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Converting VIF {"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG os_vif [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e8d0629-7d7a-5f56-8dac-3d6a12367edb', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.263s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9bef030-7b, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9bef030-7b, col_values=(('qos', UUID('4356beb5-9d4f-4e6d-bd9d-99f6e64f039d')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9bef030-7b, col_values=(('external_ids', {'iface-id': 'd9bef030-7b06-4058-ab38-ae84ea0f34d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:38:a5', 'vm-uuid': '9866d0ef-d713-4601-b797-780abd5fb7af'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:13 user nova-compute[74880]: INFO os_vif [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b')
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Cannot resize image /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Ensure instance console log exists: /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No BDM found with device name sda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:14:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No VIF found with MAC fa:16:3e:03:38:a5, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:14:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Using config drive
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Successfully updated port: f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquired lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-changed-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Refreshing instance network info cache due to event network-changed-f33f0e62-8afe-4b3c-be48-26e9037c4193. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] Acquiring lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updated VIF entry in instance network info cache for port d9bef030-7b06-4058-ab38-ae84ea0f34d1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updating instance_info_cache with network_info: [{"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2a8f9024-5e9c-4286-8217-cbff9daf7e19 req-cca84c96-9084-4c69-bae2-8f36c4f95f8f service nova] Releasing lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updating instance_info_cache with network_info: [{"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:14 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Creating config drive at /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.config
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu3mminyr {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Releasing lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Instance network_info: |[{"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] Acquired lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.neutron [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Refreshing network info cache for port f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Start _get_guest_xml network_info=[{"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu3mminyr" returned: 0 in 0.065s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:14 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:14 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-355533538',display_name='tempest-TestVolumeSwap-server-355533538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-355533538',id=8,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7ibjxx6ag/J4385qS/22g0sLzcL5Cpad/XEpD5hQe+OhBzc4OqjEoj2D2MotKbZjhklWsL71vRHcSlQ0vfaM85jcxTGWE3+47oXTBtQNcB0uZ7ra52ObVXUJKL2ytwMw==',key_name='tempest-keypair-637086337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bb57a1bb274bbda3c9f0ffffc67762',ramdisk_id='',reservation_id='r-1vfp3ws0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1403746086',owner_user_name='tempest-TestVolumeSwap-1403746086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f40427608ceb483da72faee674ab92a6',uuid=ec08677b-c923-4307-855e-c6326dfedf6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Converting VIF {"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lazy-loading 'pci_devices' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:14:14 user nova-compute[74880]:   <uuid>ec08677b-c923-4307-855e-c6326dfedf6e</uuid>
Nov 15 01:14:14 user nova-compute[74880]:   <name>instance-00000008</name>
Nov 15 01:14:14 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:14:14 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:14:14 user nova-compute[74880]:   <metadata>
Nov 15 01:14:14 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:14:14 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:14:14 user nova-compute[74880]:       <nova:name>tempest-TestVolumeSwap-server-355533538</nova:name>
Nov 15 01:14:14 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:14:14</nova:creationTime>
Nov 15 01:14:14 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:14:14 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:14:14 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:14:14 user nova-compute[74880]:       <nova:owner>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:user uuid="f40427608ceb483da72faee674ab92a6">tempest-TestVolumeSwap-1403746086-project-member</nova:user>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:project uuid="f0bb57a1bb274bbda3c9f0ffffc67762">tempest-TestVolumeSwap-1403746086</nova:project>
Nov 15 01:14:14 user nova-compute[74880]:       </nova:owner>
Nov 15 01:14:14 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:14:14 user nova-compute[74880]:       <nova:ports>
Nov 15 01:14:14 user nova-compute[74880]:         <nova:port uuid="f33f0e62-8afe-4b3c-be48-26e9037c4193">
Nov 15 01:14:14 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 01:14:14 user nova-compute[74880]:         </nova:port>
Nov 15 01:14:14 user nova-compute[74880]:       </nova:ports>
Nov 15 01:14:14 user nova-compute[74880]:     </nova:instance>
Nov 15 01:14:14 user nova-compute[74880]:   </metadata>
Nov 15 01:14:14 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:14:14 user nova-compute[74880]:     <system>
Nov 15 01:14:14 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:14:14 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:14:14 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:14:14 user nova-compute[74880]:       <entry name="serial">ec08677b-c923-4307-855e-c6326dfedf6e</entry>
Nov 15 01:14:14 user nova-compute[74880]:       <entry name="uuid">ec08677b-c923-4307-855e-c6326dfedf6e</entry>
Nov 15 01:14:14 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:14:14 user nova-compute[74880]:     </system>
Nov 15 01:14:14 user nova-compute[74880]:   </sysinfo>
Nov 15 01:14:14 user nova-compute[74880]:   <os>
Nov 15 01:14:14 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:14:14 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:14:14 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:14:14 user nova-compute[74880]:   </os>
Nov 15 01:14:14 user nova-compute[74880]:   <features>
Nov 15 01:14:14 user nova-compute[74880]:     <acpi/>
Nov 15 01:14:14 user nova-compute[74880]:     <apic/>
Nov 15 01:14:14 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:14:14 user nova-compute[74880]:   </features>
Nov 15 01:14:14 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:14:14 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:14:14 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:14:14 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:14:14 user nova-compute[74880]:   </clock>
Nov 15 01:14:14 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:14:14 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:14:14 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:14:14 user nova-compute[74880]:   </cpu>
Nov 15 01:14:14 user nova-compute[74880]:   <devices>
Nov 15 01:14:14 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:14:14 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:14:14 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk"/>
Nov 15 01:14:14 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:14:14 user nova-compute[74880]:     </disk>
Nov 15 01:14:14 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:14:14 user nova-compute[74880]:       <mac address="fa:16:3e:5f:e2:d7"/>
Nov 15 01:14:14 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:14 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:14:14 user nova-compute[74880]:       <target dev="tapf33f0e62-8a"/>
Nov 15 01:14:14 user nova-compute[74880]:     </interface>
Nov 15 01:14:14 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:14:14 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/console.log" append="off"/>
Nov 15 01:14:14 user nova-compute[74880]:     </serial>
Nov 15 01:14:14 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:14:14 user nova-compute[74880]:     <video>
Nov 15 01:14:14 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:14 user nova-compute[74880]:     </video>
Nov 15 01:14:14 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:14:14 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:14:14 user nova-compute[74880]:     </rng>
Nov 15 01:14:14 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:14:14 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:14:14 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:14:14 user nova-compute[74880]:     </memballoon>
Nov 15 01:14:14 user nova-compute[74880]:   </devices>
Nov 15 01:14:14 user nova-compute[74880]: </domain>
Nov 15 01:14:14 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-355533538',display_name='tempest-TestVolumeSwap-server-355533538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-355533538',id=8,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7ibjxx6ag/J4385qS/22g0sLzcL5Cpad/XEpD5hQe+OhBzc4OqjEoj2D2MotKbZjhklWsL71vRHcSlQ0vfaM85jcxTGWE3+47oXTBtQNcB0uZ7ra52ObVXUJKL2ytwMw==',key_name='tempest-keypair-637086337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bb57a1bb274bbda3c9f0ffffc67762',ramdisk_id='',reservation_id='r-1vfp3ws0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1403746086',owner_user_name='tempest-TestVolumeSwap-1403746086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f40427608ceb483da72faee674ab92a6',uuid=ec08677b-c923-4307-855e-c6326dfedf6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Converting VIF {"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG os_vif [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e5b18d8-b53c-5af4-bacd-906c163ec319', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf33f0e62-8a, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf33f0e62-8a, col_values=(('qos', UUID('719fb5ef-28e5-44e2-af3e-34c31db68a6a')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf33f0e62-8a, col_values=(('external_ids', {'iface-id': 'f33f0e62-8afe-4b3c-be48-26e9037c4193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:e2:d7', 'vm-uuid': 'ec08677b-c923-4307-855e-c6326dfedf6e'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:14 user nova-compute[74880]: INFO os_vif [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a')
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:14:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] No VIF found with MAC fa:16:3e:5f:e2:d7, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:14:15 user nova-compute[74880]: DEBUG nova.network.neutron [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updated VIF entry in instance network info cache for port f33f0e62-8afe-4b3c-be48-26e9037c4193. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:14:15 user nova-compute[74880]: DEBUG nova.network.neutron [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updating instance_info_cache with network_info: [{"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95f5060c-7907-4f00-8a69-eec581eb0ed9 req-0e23178d-03fe-4bce-bffa-bc7fa58e0165 service nova] Releasing lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ac3c73-f721-46c0-b5d5-0bdef150f5cb req-21bfe179-918d-4373-816c-0545c6d620fa service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ac3c73-f721-46c0-b5d5-0bdef150f5cb req-21bfe179-918d-4373-816c-0545c6d620fa service nova] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ac3c73-f721-46c0-b5d5-0bdef150f5cb req-21bfe179-918d-4373-816c-0545c6d620fa service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ac3c73-f721-46c0-b5d5-0bdef150f5cb req-21bfe179-918d-4373-816c-0545c6d620fa service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ac3c73-f721-46c0-b5d5-0bdef150f5cb req-21bfe179-918d-4373-816c-0545c6d620fa service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] No waiting events found dispatching network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:18 user nova-compute[74880]: WARNING nova.compute.manager [req-57ac3c73-f721-46c0-b5d5-0bdef150f5cb req-21bfe179-918d-4373-816c-0545c6d620fa service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received unexpected event network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 for instance with vm_state building and task_state spawning.
Nov 15 01:14:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:19 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:19 user nova-compute[74880]: INFO nova.compute.claims [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Claim successful on node user
Nov 15 01:14:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.policy [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9022a7f3c1d74a29adb72b62a479f579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d659bf5bd7481abec075ad5fa0236d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:14:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Creating image(s)
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "/opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "/opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.214s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-a21733cc-7e45-4e7d-87e7-05213d3cc7f5 req-555cda16-c2c5-44d3-b57c-6791cd064918 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a21733cc-7e45-4e7d-87e7-05213d3cc7f5 req-555cda16-c2c5-44d3-b57c-6791cd064918 service nova] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a21733cc-7e45-4e7d-87e7-05213d3cc7f5 req-555cda16-c2c5-44d3-b57c-6791cd064918 service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a21733cc-7e45-4e7d-87e7-05213d3cc7f5 req-555cda16-c2c5-44d3-b57c-6791cd064918 service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-a21733cc-7e45-4e7d-87e7-05213d3cc7f5 req-555cda16-c2c5-44d3-b57c-6791cd064918 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] No waiting events found dispatching network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:20 user nova-compute[74880]: WARNING nova.compute.manager [req-a21733cc-7e45-4e7d-87e7-05213d3cc7f5 req-555cda16-c2c5-44d3-b57c-6791cd064918 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received unexpected event network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 for instance with vm_state building and task_state spawning.
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:14:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Instance spawned successfully.
Nov 15 01:14:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:14:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Instance spawned successfully.
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.226s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:21 user nova-compute[74880]: INFO nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Took 8.41 seconds to spawn the instance on the hypervisor.
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk 1073741824" returned: 0 in 0.064s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:21 user nova-compute[74880]: INFO nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Took 11.71 seconds to spawn the instance on the hypervisor.
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.213s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:21 user nova-compute[74880]: INFO nova.compute.manager [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Took 12.99 seconds to build instance.
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7cee966-0f05-4e7b-ae36-64d898a243db tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.141s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:21 user nova-compute[74880]: INFO nova.compute.manager [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Took 11.24 seconds to build instance.
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a0d32f-6b70-4691-bb44-0a0dd03705d0 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.376s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Cannot resize image /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Ensure instance console log exists: /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Successfully created port: 8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Successfully updated port: 8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-changed-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Refreshing instance network info cache due to event network-changed-8a183bba-7c9d-4f2c-9697-34d8caed5c8a. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] Acquiring lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] Acquired lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Refreshing network info cache for port 8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e90db8ca-5b4e-4fda-b7fc-0912751840ba req-ec397b98-6d73-4aec-8a7e-85d85ad6183c service nova] Releasing lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquired lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updating instance_info_cache with network_info: [{"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Releasing lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Instance network_info: |[{"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Start _get_guest_xml network_info=[{"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:14:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1575094192',display_name='tempest-VolumesAssistedSnapshotsTest-server-1575094192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1575094192',id=9,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPCElpx3KL2Fu77voT5DEA4+KNIgNNuRIsQDeOlG+NktRv28ALLLKWyKe+iqMTmJsovzeHil9rU7/NbZXTW3vLnjYG6eG6Tl+uFIBMf1PK8xZYsZwOYCvOdvEgqDZ+WzQ==',key_name='tempest-keypair-29565132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d659bf5bd7481abec075ad5fa0236d',ramdisk_id='',reservation_id='r-eiukv822',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1340056055',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1340056055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9022a7f3c1d74a29adb72b62a479f579',uuid=8dbd7773-a064-47c0-926f-c12afcb24d7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Converting VIF {"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:14:23 user nova-compute[74880]:   <uuid>8dbd7773-a064-47c0-926f-c12afcb24d7f</uuid>
Nov 15 01:14:23 user nova-compute[74880]:   <name>instance-00000009</name>
Nov 15 01:14:23 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:14:23 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:14:23 user nova-compute[74880]:   <metadata>
Nov 15 01:14:23 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:14:23 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:14:23 user nova-compute[74880]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1575094192</nova:name>
Nov 15 01:14:23 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:14:23</nova:creationTime>
Nov 15 01:14:23 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:14:23 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:14:23 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:14:23 user nova-compute[74880]:       <nova:owner>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:user uuid="9022a7f3c1d74a29adb72b62a479f579">tempest-VolumesAssistedSnapshotsTest-1340056055-project-member</nova:user>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:project uuid="d0d659bf5bd7481abec075ad5fa0236d">tempest-VolumesAssistedSnapshotsTest-1340056055</nova:project>
Nov 15 01:14:23 user nova-compute[74880]:       </nova:owner>
Nov 15 01:14:23 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:14:23 user nova-compute[74880]:       <nova:ports>
Nov 15 01:14:23 user nova-compute[74880]:         <nova:port uuid="8a183bba-7c9d-4f2c-9697-34d8caed5c8a">
Nov 15 01:14:23 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 01:14:23 user nova-compute[74880]:         </nova:port>
Nov 15 01:14:23 user nova-compute[74880]:       </nova:ports>
Nov 15 01:14:23 user nova-compute[74880]:     </nova:instance>
Nov 15 01:14:23 user nova-compute[74880]:   </metadata>
Nov 15 01:14:23 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:14:23 user nova-compute[74880]:     <system>
Nov 15 01:14:23 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:14:23 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:14:23 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:14:23 user nova-compute[74880]:       <entry name="serial">8dbd7773-a064-47c0-926f-c12afcb24d7f</entry>
Nov 15 01:14:23 user nova-compute[74880]:       <entry name="uuid">8dbd7773-a064-47c0-926f-c12afcb24d7f</entry>
Nov 15 01:14:23 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:14:23 user nova-compute[74880]:     </system>
Nov 15 01:14:23 user nova-compute[74880]:   </sysinfo>
Nov 15 01:14:23 user nova-compute[74880]:   <os>
Nov 15 01:14:23 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:14:23 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:14:23 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:14:23 user nova-compute[74880]:   </os>
Nov 15 01:14:23 user nova-compute[74880]:   <features>
Nov 15 01:14:23 user nova-compute[74880]:     <acpi/>
Nov 15 01:14:23 user nova-compute[74880]:     <apic/>
Nov 15 01:14:23 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:14:23 user nova-compute[74880]:   </features>
Nov 15 01:14:23 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:14:23 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:14:23 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:14:23 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:14:23 user nova-compute[74880]:   </clock>
Nov 15 01:14:23 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:14:23 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:14:23 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:14:23 user nova-compute[74880]:   </cpu>
Nov 15 01:14:23 user nova-compute[74880]:   <devices>
Nov 15 01:14:23 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:14:23 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:14:23 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk"/>
Nov 15 01:14:23 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:14:23 user nova-compute[74880]:     </disk>
Nov 15 01:14:23 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:14:23 user nova-compute[74880]:       <mac address="fa:16:3e:70:3c:44"/>
Nov 15 01:14:23 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:23 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:14:23 user nova-compute[74880]:       <target dev="tap8a183bba-7c"/>
Nov 15 01:14:23 user nova-compute[74880]:     </interface>
Nov 15 01:14:23 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:14:23 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/console.log" append="off"/>
Nov 15 01:14:23 user nova-compute[74880]:     </serial>
Nov 15 01:14:23 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:14:23 user nova-compute[74880]:     <video>
Nov 15 01:14:23 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:23 user nova-compute[74880]:     </video>
Nov 15 01:14:23 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:14:23 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:14:23 user nova-compute[74880]:     </rng>
Nov 15 01:14:23 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:14:23 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:14:23 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:14:23 user nova-compute[74880]:     </memballoon>
Nov 15 01:14:23 user nova-compute[74880]:   </devices>
Nov 15 01:14:23 user nova-compute[74880]: </domain>
Nov 15 01:14:23 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1575094192',display_name='tempest-VolumesAssistedSnapshotsTest-server-1575094192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1575094192',id=9,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPCElpx3KL2Fu77voT5DEA4+KNIgNNuRIsQDeOlG+NktRv28ALLLKWyKe+iqMTmJsovzeHil9rU7/NbZXTW3vLnjYG6eG6Tl+uFIBMf1PK8xZYsZwOYCvOdvEgqDZ+WzQ==',key_name='tempest-keypair-29565132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0d659bf5bd7481abec075ad5fa0236d',ramdisk_id='',reservation_id='r-eiukv822',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1340056055',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1340056055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9022a7f3c1d74a29adb72b62a479f579',uuid=8dbd7773-a064-47c0-926f-c12afcb24d7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Converting VIF {"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG os_vif [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '367eb2ad-b788-5681-8b55-9e2132d4780a', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a183bba-7c, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a183bba-7c, col_values=(('qos', UUID('cdc305e0-30ca-4a71-80ea-63df428255a2')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a183bba-7c, col_values=(('external_ids', {'iface-id': '8a183bba-7c9d-4f2c-9697-34d8caed5c8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:3c:44', 'vm-uuid': '8dbd7773-a064-47c0-926f-c12afcb24d7f'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:23 user nova-compute[74880]: INFO os_vif [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c')
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:14:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] No VIF found with MAC fa:16:3e:70:3c:44, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:14:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-8a3d5b05-85dc-4153-a159-99aa2eac430c req-debd99b7-8825-422a-a623-3d849a6ed6e6 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8a3d5b05-85dc-4153-a159-99aa2eac430c req-debd99b7-8825-422a-a623-3d849a6ed6e6 service nova] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8a3d5b05-85dc-4153-a159-99aa2eac430c req-debd99b7-8825-422a-a623-3d849a6ed6e6 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8a3d5b05-85dc-4153-a159-99aa2eac430c req-debd99b7-8825-422a-a623-3d849a6ed6e6 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-8a3d5b05-85dc-4153-a159-99aa2eac430c req-debd99b7-8825-422a-a623-3d849a6ed6e6 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] No waiting events found dispatching network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:26 user nova-compute[74880]: WARNING nova.compute.manager [req-8a3d5b05-85dc-4153-a159-99aa2eac430c req-debd99b7-8825-422a-a623-3d849a6ed6e6 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received unexpected event network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a for instance with vm_state building and task_state spawning.
Nov 15 01:14:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-88df5acf-2b7f-4950-aa60-a1c4a877bf9b req-dbcff6ec-cbed-4e50-81ff-d3aa9ce75339 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-88df5acf-2b7f-4950-aa60-a1c4a877bf9b req-dbcff6ec-cbed-4e50-81ff-d3aa9ce75339 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-88df5acf-2b7f-4950-aa60-a1c4a877bf9b req-dbcff6ec-cbed-4e50-81ff-d3aa9ce75339 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-88df5acf-2b7f-4950-aa60-a1c4a877bf9b req-dbcff6ec-cbed-4e50-81ff-d3aa9ce75339 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-88df5acf-2b7f-4950-aa60-a1c4a877bf9b req-dbcff6ec-cbed-4e50-81ff-d3aa9ce75339 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:28 user nova-compute[74880]: WARNING nova.compute.manager [req-88df5acf-2b7f-4950-aa60-a1c4a877bf9b req-dbcff6ec-cbed-4e50-81ff-d3aa9ce75339 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state active and task_state None.
Nov 15 01:14:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-6eeb7211-9425-4bf4-920e-854a6720713f req-e337b6cd-1030-4a7a-bfb0-bc1b4668e916 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6eeb7211-9425-4bf4-920e-854a6720713f req-e337b6cd-1030-4a7a-bfb0-bc1b4668e916 service nova] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6eeb7211-9425-4bf4-920e-854a6720713f req-e337b6cd-1030-4a7a-bfb0-bc1b4668e916 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6eeb7211-9425-4bf4-920e-854a6720713f req-e337b6cd-1030-4a7a-bfb0-bc1b4668e916 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-6eeb7211-9425-4bf4-920e-854a6720713f req-e337b6cd-1030-4a7a-bfb0-bc1b4668e916 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] No waiting events found dispatching network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:28 user nova-compute[74880]: WARNING nova.compute.manager [req-6eeb7211-9425-4bf4-920e-854a6720713f req-e337b6cd-1030-4a7a-bfb0-bc1b4668e916 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received unexpected event network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a for instance with vm_state building and task_state spawning.
Nov 15 01:14:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:14:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Instance spawned successfully.
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:29 user nova-compute[74880]: INFO nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Took 8.68 seconds to spawn the instance on the hypervisor.
Nov 15 01:14:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:14:29 user nova-compute[74880]: INFO nova.compute.manager [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Took 9.75 seconds to build instance.
Nov 15 01:14:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ca9e8797-86b7-4d43-9ab7-9b07746cfcdc tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.895s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:30 user nova-compute[74880]: WARNING nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state active and task_state None.
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] No waiting events found dispatching network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:30 user nova-compute[74880]: WARNING nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received unexpected event network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 for instance with vm_state active and task_state None.
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] No waiting events found dispatching network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:30 user nova-compute[74880]: WARNING nova.compute.manager [req-297b164d-5bf4-4dfd-8331-5940059fb702 req-6b7ad38a-439e-46fd-8946-1b56911b72be service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received unexpected event network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 for instance with vm_state active and task_state None.
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:33 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:33 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:14:34 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:36 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:41 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:41 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.76132583618164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance bc155ceb-d7ca-477b-8479-a459fa50af05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9866d0ef-d713-4601-b797-780abd5fb7af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ec08677b-c923-4307-855e-c6326dfedf6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8dbd7773-a064-47c0-926f-c12afcb24d7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 026890b4-5a76-4730-bc20-54b95359bdcc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:14:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.902s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.352s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:42 user nova-compute[74880]: INFO nova.compute.claims [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Claim successful on node user
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.128s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:42 user nova-compute[74880]: INFO nova.compute.claims [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Claim successful on node user
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.policy [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddd620f3b9e94da58eba4c41008b4c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f88735b9c54ff08003cf50e6672982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:14:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Creating image(s)
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "/opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "/opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "/opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.168s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk 1073741824" returned: 0 in 0.069s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:14:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:43 user nova-compute[74880]: INFO nova.virt.block_device [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Booting with volume 7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 at /dev/vda
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.policy [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f104b53490e44b2f9ab950b9d382909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afd6b79ca734255a07a8a9273706ca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG os_brick.utils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:14:44 user nova-compute[74880]: INFO oslo.privsep.daemon [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptyskodsn/privsep.sock']
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Cannot resize image /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Ensure instance console log exists: /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:44 user sudo[85940]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptyskodsn/privsep.sock
Nov 15 01:14:44 user sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Successfully created port: 79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully created port: 65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Successfully updated port: 79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquired lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-changed-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Refreshing instance network info cache due to event network-changed-79379e5f-03d1-42b8-aff4-71297ee3f026. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] Acquiring lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully created port: f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updating instance_info_cache with network_info: [{"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Releasing lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Instance network_info: |[{"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] Acquired lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Refreshing network info cache for port 79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Start _get_guest_xml network_info=[{"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:14:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-122727823',display_name='tempest-TestServerVolumeAttachmentScenario-server-122727823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-122727823',id=10,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUW+qiPFt0RgTyTq/OTay2LTA64jjQB3wMHAF9D5JyPnUUQStlr/2pu+Geil8tHyuFDaNbxaQmNmmMjVumwI/74ADLqxZHJRodDT8jdGrsIHJTwXFh9PxR99fTrNG0CRA==',key_name='tempest-keypair-2095369327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f88735b9c54ff08003cf50e6672982',ramdisk_id='',reservation_id='r-ixkdepwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-573761567',owner_user_name='tempest-TestServerVolumeAttachmentScenario-573761567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd620f3b9e94da58eba4c41008b4c44',uuid=026890b4-5a76-4730-bc20-54b95359bdcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Converting VIF {"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'pci_devices' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:14:45 user nova-compute[74880]:   <uuid>026890b4-5a76-4730-bc20-54b95359bdcc</uuid>
Nov 15 01:14:45 user nova-compute[74880]:   <name>instance-0000000a</name>
Nov 15 01:14:45 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:14:45 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:14:45 user nova-compute[74880]:   <metadata>
Nov 15 01:14:45 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:14:45 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:14:45 user nova-compute[74880]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-122727823</nova:name>
Nov 15 01:14:45 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:14:45</nova:creationTime>
Nov 15 01:14:45 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:14:45 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:14:45 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:14:45 user nova-compute[74880]:       <nova:owner>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:user uuid="ddd620f3b9e94da58eba4c41008b4c44">tempest-TestServerVolumeAttachmentScenario-573761567-project-member</nova:user>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:project uuid="b2f88735b9c54ff08003cf50e6672982">tempest-TestServerVolumeAttachmentScenario-573761567</nova:project>
Nov 15 01:14:45 user nova-compute[74880]:       </nova:owner>
Nov 15 01:14:45 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:14:45 user nova-compute[74880]:       <nova:ports>
Nov 15 01:14:45 user nova-compute[74880]:         <nova:port uuid="79379e5f-03d1-42b8-aff4-71297ee3f026">
Nov 15 01:14:45 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:14:45 user nova-compute[74880]:         </nova:port>
Nov 15 01:14:45 user nova-compute[74880]:       </nova:ports>
Nov 15 01:14:45 user nova-compute[74880]:     </nova:instance>
Nov 15 01:14:45 user nova-compute[74880]:   </metadata>
Nov 15 01:14:45 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:14:45 user nova-compute[74880]:     <system>
Nov 15 01:14:45 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:14:45 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:14:45 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:14:45 user nova-compute[74880]:       <entry name="serial">026890b4-5a76-4730-bc20-54b95359bdcc</entry>
Nov 15 01:14:45 user nova-compute[74880]:       <entry name="uuid">026890b4-5a76-4730-bc20-54b95359bdcc</entry>
Nov 15 01:14:45 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:14:45 user nova-compute[74880]:     </system>
Nov 15 01:14:45 user nova-compute[74880]:   </sysinfo>
Nov 15 01:14:45 user nova-compute[74880]:   <os>
Nov 15 01:14:45 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:14:45 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:14:45 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:14:45 user nova-compute[74880]:   </os>
Nov 15 01:14:45 user nova-compute[74880]:   <features>
Nov 15 01:14:45 user nova-compute[74880]:     <acpi/>
Nov 15 01:14:45 user nova-compute[74880]:     <apic/>
Nov 15 01:14:45 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:14:45 user nova-compute[74880]:   </features>
Nov 15 01:14:45 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:14:45 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:14:45 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:14:45 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:14:45 user nova-compute[74880]:   </clock>
Nov 15 01:14:45 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:14:45 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:14:45 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:14:45 user nova-compute[74880]:   </cpu>
Nov 15 01:14:45 user nova-compute[74880]:   <devices>
Nov 15 01:14:45 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:14:45 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:14:45 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk"/>
Nov 15 01:14:45 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:14:45 user nova-compute[74880]:     </disk>
Nov 15 01:14:45 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:14:45 user nova-compute[74880]:       <mac address="fa:16:3e:c5:a0:82"/>
Nov 15 01:14:45 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:45 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:14:45 user nova-compute[74880]:       <target dev="tap79379e5f-03"/>
Nov 15 01:14:45 user nova-compute[74880]:     </interface>
Nov 15 01:14:45 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:14:45 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/console.log" append="off"/>
Nov 15 01:14:45 user nova-compute[74880]:     </serial>
Nov 15 01:14:45 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:14:45 user nova-compute[74880]:     <video>
Nov 15 01:14:45 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:14:45 user nova-compute[74880]:     </video>
Nov 15 01:14:45 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:14:45 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:14:45 user nova-compute[74880]:     </rng>
Nov 15 01:14:45 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:14:45 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:14:45 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:14:45 user nova-compute[74880]:     </memballoon>
Nov 15 01:14:45 user nova-compute[74880]:   </devices>
Nov 15 01:14:45 user nova-compute[74880]: </domain>
Nov 15 01:14:45 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-122727823',display_name='tempest-TestServerVolumeAttachmentScenario-server-122727823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-122727823',id=10,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUW+qiPFt0RgTyTq/OTay2LTA64jjQB3wMHAF9D5JyPnUUQStlr/2pu+Geil8tHyuFDaNbxaQmNmmMjVumwI/74ADLqxZHJRodDT8jdGrsIHJTwXFh9PxR99fTrNG0CRA==',key_name='tempest-keypair-2095369327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f88735b9c54ff08003cf50e6672982',ramdisk_id='',reservation_id='r-ixkdepwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-573761567',owner_user_name='tempest-TestServerVolumeAttachmentScenario-573761567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd620f3b9e94da58eba4c41008b4c44',uuid=026890b4-5a76-4730-bc20-54b95359bdcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Converting VIF {"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG os_vif [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80e403e3-794a-5781-93d4-58872407ea3d', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79379e5f-03, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79379e5f-03, col_values=(('qos', UUID('a5fd4c6d-a42b-44e9-a2f7-b1c245a54491')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79379e5f-03, col_values=(('external_ids', {'iface-id': '79379e5f-03d1-42b8-aff4-71297ee3f026', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a0:82', 'vm-uuid': '026890b4-5a76-4730-bc20-54b95359bdcc'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: INFO os_vif [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03')
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No VIF found with MAC fa:16:3e:c5:a0:82, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updated VIF entry in instance network info cache for port 79379e5f-03d1-42b8-aff4-71297ee3f026. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updating instance_info_cache with network_info: [{"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:45 user sudo[85940]: pam_unix(sudo:session): session closed for user root
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f57202ac-41c1-4ce4-9391-598b3032357d req-f0d497b9-4636-4dd0-a816-fc026bc47bd8 service nova] Releasing lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:45 user nova-compute[74880]: INFO oslo.privsep.daemon [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Spawned new privsep daemon via rootwrap
Nov 15 01:14:45 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 01:14:45 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 01:14:45 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 01:14:45 user nova-compute[74880]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85948
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully created port: 37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d654e1-9048-4243-8e09-a203ed8a227e]: (2,) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "23781762-45a9-4943-b18e-19f6b8784e32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:14:45 user nova-compute[74880]: INFO nova.compute.claims [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Claim successful on node user
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[49360530-4c8b-4190-ad36-133a23408f05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:45 user nova-compute[74880]: WARNING os_brick.initiator.connectors.nvmeof [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[29116be6-f724-4252-ba89-c6fd3ec5cd8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e301cdb5-497c-4790-9a72-81eede4386c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b63d966-6fde-41fe-9e4b-e4fd848c8bc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:45 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:14:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e913b9-f7d7-4d10-b66c-b5f12d4b3ced]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG os_brick.utils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== get_connector_properties: return (1874ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:14:45 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating existing volume attachment record: 29ccfbf1-5342-4664-bfa3-5a5b88294cc5 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully created port: 80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:14:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:46 user nova-compute[74880]: INFO nova.virt.block_device [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Booting with volume 23be2835-cba7-444f-8f02-60d73e3f0f51 at /dev/vda
Nov 15 01:14:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.policy [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59df6ca8a4b548ada0802c33cf9d6b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0439938f3f1c4f349e26159daa0d3e5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG os_brick.utils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe944fb-145a-4863-930f-e0394bda00cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a2e1b-d6ef-49b7-85d1-f708f8e4f1f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceec093-840c-4756-bea6-92716bee606f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e29a9b2-b471-4903-ab29-c940f48d632f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] No waiting events found dispatching network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:46 user nova-compute[74880]: WARNING nova.compute.manager [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received unexpected event network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 for instance with vm_state active and task_state None.
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] No waiting events found dispatching network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:46 user nova-compute[74880]: WARNING nova.compute.manager [req-b0196edc-50bd-49ff-aeb7-e9da8ae8ea00 req-59148d7d-942a-4425-9d78-1a47aabda204 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received unexpected event network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 for instance with vm_state active and task_state None.
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:46 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:14:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[142951e4-7438-4a41-97f3-7ec07999afea]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG os_brick.utils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:14:46 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating existing volume attachment record: b29f2284-8de1-4a11-abb5-6306fc31a8b8 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully created port: 680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully created port: ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: 65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-65bd5242-7df3-407c-b280-752f322cd1e8. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port 65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0f076ed7-84fe-4353-aee4-1b7c7c37be6b req-cb4a7f52-8c38-4a79-8f0a-56f72a880744 service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully created port: 51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:48 user nova-compute[74880]: WARNING nova.compute.manager [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received unexpected event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with vm_state building and task_state spawning.
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:14:48 user nova-compute[74880]: WARNING nova.compute.manager [req-0e0d50aa-7895-491f-97c4-f85bbfc6792e req-7aa68793-ebc3-42f5-b953-f52101e99476 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received unexpected event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with vm_state building and task_state spawning.
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully created port: 2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:14:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Instance spawned successfully.
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:14:49 user nova-compute[74880]: INFO nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:14:49 user nova-compute[74880]: INFO nova.compute.manager [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Took 7.30 seconds to build instance.
Nov 15 01:14:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2365c1b-d488-4c0d-a707-61b265ba7ae4 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.420s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully created port: b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-a1345ad0-2bcd-4bdb-bcac-645d7b498f81. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-f3bbc7b6-fa80-4857-a289-8690cd7bafdc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully created port: a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aef3d6f9-b563-4bd0-8df7-a2d7e7f1eab7 req-3c7e63fd-a6ef-4d4e-998d-b115acdf977a service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: 37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:51 user nova-compute[74880]: INFO nova.virt.block_device [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Booting with volume 62b36c2b-8af5-40a0-9f16-bde131eda69d at /dev/vdb
Nov 15 01:14:51 user nova-compute[74880]: DEBUG os_brick.utils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4b64e3-41dd-4b1e-a660-cf2e5b24e884]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f3f36-df75-48a2-b57e-b194c81fb231]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: 80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c31f87f-88c5-4ac9-bc7b-93120084195b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf57c76-c718-4351-9e0c-22bac1a2ba4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:51 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:14:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a9b950-8a86-47d2-9dc8-7cde13fa8e3d]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating existing volume attachment record: 28f4b2ee-713c-4cd8-9ae2-a8263ba77701 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-f4533027-a664-41c8-8206-71edcee4601b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:52 user nova-compute[74880]: INFO nova.virt.block_device [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Booting with volume 9a49ba88-9eb9-4158-8247-996de5791ae1 at /dev/vdb
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-37702930-fabc-4f04-b5c5-5bc31ea04af3. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port 37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e9547-6c2b-40bb-bfb4-9ecf2292ddc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d873485-5b70-403f-bf73-9c12ca4520fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdec2bb-d60b-4dd2-aefb-76570c2b9d78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc2f403-6558-4e13-a929-e0c9d2ced8b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:52 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb537e6-e672-4730-a0ec-ce8f0e206401]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating existing volume attachment record: b25752a7-97fe-4349-a384-a7bac3626f49 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port 80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Successfully updated port: 680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8376f3ef-755f-483c-943b-d6c5171eb338 req-ffb54b31-da85-4da9-bc21-7d523526fb09 service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-49afb907-90cd-48d5-bfba-283683e3e562 req-14500139-08c5-4e9d-827f-c16de81033bc service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-680b6bd7-ed4c-46c1-ac8c-4fc537e11894. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-dbb433bd-a744-47b9-96d6-13d96cd28aab. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-be039904-fb17-4366-9841-041d756140be req-4ab08809-e195-4f18-a0ac-5da5492b97d9 service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: 8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: 51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance network_info: |[{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port 680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-8f45863a-e5c2-4e68-8148-0fc88358f378. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port 8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-51ae329b-195b-49ca-b783-2a16649b2776. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port 51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5bca0c4-0b38-405e-a057-760d291bb1b6 req-72ce134c-86b8-4ca4-88d8-092a4f08a4e7 service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updated VIF entry in instance network info cache for port 680b6bd7-ed4c-46c1-ac8c-4fc537e11894. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42bb0f52-07c7-43ad-9263-f63c2124e720 req-b53a5272-61ae-4461-8f6b-31b7894cb14a service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:57 user nova-compute[74880]: INFO nova.virt.block_device [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Booting with volume 78debe92-ae27-48c9-be7c-9525e8548e9c at /dev/vdc
Nov 15 01:14:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: 2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.utils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8175fd-9324-493d-9c87-0048cd02adf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214e8d1-a312-4923-8b0c-9c6eb3e70971]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[518bd80f-00c8-4a74-9afe-6699cf475cb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae91f69-9602-4b2b-9e4e-512738da2815]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:57 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f464b6-8f3f-4ef0-a25b-45777f331692]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.utils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating existing volume attachment record: 41d976fd-9378-49a8-abf0-36c0a647fa93 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:14:57 user nova-compute[74880]: INFO nova.virt.block_device [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Booting with volume 01445dba-22e1-47d2-837c-6bb3165c6fb8 at /dev/vdc
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.utils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9484e6-193c-4357-a0a0-9409547539d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5227a602-4180-4a4a-9e4c-27cb4ccef844]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0ebd6c-2b89-4bce-9354-ddf129b30c41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c49f50-17f2-4e52-84bf-8fb09ba7ebb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:14:57 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:14:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[82128654-eef7-42b5-99a0-af3c22e1409a]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG os_brick.utils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:14:57 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating existing volume attachment record: b209c3e7-2711-4396-be04-e2899276ffed {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-2991e3ac-7594-43bd-aa53-f63a10d89df2. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG nova.network.neutron [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port 2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:58 user nova-compute[74880]: DEBUG nova.network.neutron [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-b346fb6d-f804-4286-9f11-4796d62b50d5. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Successfully updated port: a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fd40e0c8-f5d6-4475-8dba-c8bed88dfab5 req-9b828047-037b-4158-967d-d479ee4cc8cf service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:14:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:15:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-a3e38161-fe09-4747-af12-b673abc3b159. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:15:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance network_info: |[{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:15:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:15:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updated VIF entry in instance network info cache for port a3e38161-fe09-4747-af12-b673abc3b159. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:15:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42d42f92-cdd1-4aa6-bea0-7e209438163f req-a9d33175-ab61-4737-8240-34e0b3f5558a service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:15:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Creating image(s)
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Ensure instance console log exists: /opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Start _get_guest_xml network_info=[{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNTPuKtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9', 'attached_at': '', 'detached_at': '', 'volume_id': '7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52', 'serial': '7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52'}, 'mount_device': '/dev/vda', 'attachment_id': '29ccfbf1-5342-4664-bfa3-5a5b88294cc5', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXsgQeOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9', 'attached_at': '', 'detached_at': '', 'volume_id': '62b36c2b-8af5-40a0-9f16-bde131eda69d', 'serial': '62b36c2b-8af5-40a0-9f16-bde131eda69d'}, 'mount_device': '/dev/vdb', 'attachment_id': '28f4b2ee-713c-4cd8-9ae2-a8263ba77701', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFVtDUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9', 'attached_at': '', 'detached_at': '', 'volume_id': '78debe92-ae27-48c9-be7c-9525e8548e9c', 'serial': '78debe92-ae27-48c9-be7c-9525e8548e9c'}, 'mount_device': '/dev/vdc', 'attachment_id': '41d976fd-9378-49a8-abf0-36c0a647fa93', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:15:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connector [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Factory for ISCSI on None {{(pid=74880) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNTPuKtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:03 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:03 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:03 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c749b-68c0-451f-87a0-a006eb3f5015]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:03 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e93486b-f608-40aa-9576-b4fa9eb11145]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52] added
Nov 15 01:15:03 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.082s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b859f-4254-4f64-8393-f92dc8692ac6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e777f-4812-4474-85cd-4877ee1c8945]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNTPuKtm {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNTPuKtm" returned: 0 in 0.142s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af285ee7-93be-4cad-abc0-0911110433bb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sNTPuKtm'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054f4a8-78bd-4c43-b184-07c07ea2123f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[de834c3b-5cac-45bd-b204-2ae124912e5d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:15:03 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:15:03 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:03 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 01:15:03 user nova-compute[74880]: 
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b18ac5d-e1b9-476d-be8e-c2f983691942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260]
Nov 15 01:15:03 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:03 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5acadf2-4574-4b29-aedd-922cc49fc8fd]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b121d75-cc70-4075-9a8c-0ef57e497357]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:03 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:03 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.509s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:15:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Creating image(s)
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Ensure instance console log exists: /opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Start _get_guest_xml network_info=[{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSJVsrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23781762-45a9-4943-b18e-19f6b8784e32', 'attached_at': '', 'detached_at': '', 'volume_id': '23be2835-cba7-444f-8f02-60d73e3f0f51', 'serial': '23be2835-cba7-444f-8f02-60d73e3f0f51'}, 'mount_device': '/dev/vda', 'attachment_id': 'b29f2284-8de1-4a11-abb5-6306fc31a8b8', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOmuTwsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23781762-45a9-4943-b18e-19f6b8784e32', 'attached_at': '', 'detached_at': '', 'volume_id': '9a49ba88-9eb9-4158-8247-996de5791ae1', 'serial': '9a49ba88-9eb9-4158-8247-996de5791ae1'}, 'mount_device': '/dev/vdb', 'attachment_id': 'b25752a7-97fe-4349-a384-a7bac3626f49', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTbsexLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23781762-45a9-4943-b18e-19f6b8784e32', 'attached_at': '', 'detached_at': '', 'volume_id': '01445dba-22e1-47d2-837c-6bb3165c6fb8', 'serial': '01445dba-22e1-47d2-837c-6bb3165c6fb8'}, 'mount_device': '/dev/vdc', 'attachment_id': 'b209c3e7-2711-4396-be04-e2899276ffed', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd208bd-30e3-4946-ae74-59a69f85009c]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNTPuKtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSJVsrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:03 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '23961313239663638', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961313239663638', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.965s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:04 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ee00f-4a79-494b-bcb8-53417a8d25dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:04 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXsgQeOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[252cb230-e8c1-4ef0-ae32-d55a958acbb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51] added
Nov 15 01:15:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5346504b-6804-4105-b7b4-2e64b44bafde]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee52b69a-eb0d-41c9-bd12-f1fe5634535f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkSJVsrT {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkSJVsrT" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de3c862-fbdf-4e36-8214-d2bb84c8a46a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkSJVsrT'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[52084623-2355-401f-abad-2078516b2040]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3856a5f7-75ef-4edf-8d99-f7d237874ed5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a8dc77-45e3-4aaa-b7d9-9351a693132c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260]
Nov 15 01:15:04 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[904a5584-0a81-43f4-a474-d5f5e67d50c6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05b498-60d1-4af6-aed7-37b452744e43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:04 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:04 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[20374cdc-fb3e-49d0-9081-d4e630a76f0c]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSJVsrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== connect_volume: return (2252ms) {'type': 'block', 'scsi_wwn': '23233653130323039', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233653130323039', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.259s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:05 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:05 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[355bfd5e-2496-4868-b4e2-24fba725ffca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:06 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOmuTwsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9de10f-3b54-4aee-92b5-2984c790f934]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d] added
Nov 15 01:15:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d627d-7e1d-4e1b-b23c-3fb991c54f5b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1d5e82-20ea-4c44-b3f1-6b02e6e51d8d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXsgQeOd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXsgQeOd" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3987f471-1fb7-440e-bb58-3b79dbfcae69]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXsgQeOd'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9b3f3-669c-4dc5-aac3-fd8cebce9579]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d7b1a9-de4c-415b-ada7-8b46313d83f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4144916-5e6a-48e2-9ac1-cced42a93a36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260]
Nov 15 01:15:06 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9939aa56-fe57-422c-800e-32d3d73305c0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef24233-8b71-4b65-ad7f-3c7f3dac53d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:06 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a8532a-e63a-4fa6-b908-a4939e912a5c]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXsgQeOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== connect_volume: return (2551ms) {'type': 'block', 'scsi_wwn': '23238366661386430', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238366661386430', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.265s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:07 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:07 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0e03b6-124e-4601-8b53-d3200296b1b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:07 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFVtDUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:07 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bef3796-f007-4a13-9abe-22f89ee5bd51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1] added
Nov 15 01:15:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c29dd7-8474-4ee6-b8f6-4b9f2f65a3d1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[098a6cad-a937-435a-ac41-49dbfec672ba]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOmuTwsK {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOmuTwsK" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3236b575-6562-47a3-b0d9-d4c53bf279f8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VOmuTwsK'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bdc95f-78e4-4499-a107-2c03afc1549d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f3c57-203b-49da-8780-a410a1699441]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f52002-d4e8-4611-9e0a-213e2138e804]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260]
Nov 15 01:15:07 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d4e543-0d97-406c-b848-fa8c30ed17c8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a1762-17d7-4c38-ab50-4f7236627628]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:07 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d326b55-7e17-4f98-ae90-1301a9197131]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOmuTwsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== connect_volume: return (2561ms) {'type': 'block', 'scsi_wwn': '26364303534653762', 'path': '/dev/sde'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364303534653762', 'path': '/dev/sde'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.266s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:08 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:08 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[85822fdd-e7fb-454f-bff6-e9965c7bff16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:08 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTbsexLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:08 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d473fb08-e8e7-4249-b666-ec9593844551]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c] added
Nov 15 01:15:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26ff87-94fe-4b3d-8729-b9a0ba7f74ae]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[814f27a1-a0bd-47df-a93f-ecc898624138]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFVtDUim {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFVtDUim" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ffc247-da9e-4589-9f27-3508e3670937]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFVtDUim'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493756e-821a-4a42-bab2-b95b6da9b3c5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d4efb7-df1a-426a-9ced-636537b77b69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55187dd-9899-44a0-bb3b-515ca7cb33f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260]
Nov 15 01:15:08 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb03fa9-4a68-4963-81c8-6cfe9e76d034]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee0e22d-019b-4628-9051-a60794aff232]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:08 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c2b2e4-e00b-402f-b801-2f22cd721b89]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFVtDUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== connect_volume: return (2592ms) {'type': 'block', 'scsi_wwn': '23038376331633565', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038376331633565', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.301s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:09 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:09 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f98ec-def2-4bf9-8cfb-a96144212d7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:09 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lazy-loading 'pci_devices' on Instance uuid dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c2c4d-9db5-422f-8c28-4bdc110dc3b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8] added
Nov 15 01:15:09 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:15:09 user nova-compute[74880]:   <uuid>dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9</uuid>
Nov 15 01:15:09 user nova-compute[74880]:   <name>instance-0000000b</name>
Nov 15 01:15:09 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:15:09 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:15:09 user nova-compute[74880]:   <metadata>
Nov 15 01:15:09 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:15:09 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:15:09 user nova-compute[74880]:       <nova:name>tempest-device-tagging-server-135110245</nova:name>
Nov 15 01:15:09 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:15:03</nova:creationTime>
Nov 15 01:15:09 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:15:09 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:15:09 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:15:09 user nova-compute[74880]:       <nova:owner>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:user uuid="f104b53490e44b2f9ab950b9d382909c">tempest-TaggedBootDevicesTest_v242-5491643-project-member</nova:user>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:project uuid="3afd6b79ca734255a07a8a9273706ca4">tempest-TaggedBootDevicesTest_v242-5491643</nova:project>
Nov 15 01:15:09 user nova-compute[74880]:       </nova:owner>
Nov 15 01:15:09 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:15:09 user nova-compute[74880]:       <nova:ports>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="65bd5242-7df3-407c-b280-752f322cd1e8">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="a1345ad0-2bcd-4bdb-bcac-645d7b498f81">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="f3bbc7b6-fa80-4857-a289-8690cd7bafdc">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.88" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="f4533027-a664-41c8-8206-71edcee4601b">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="37702930-fabc-4f04-b5c5-5bc31ea04af3">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="80fb2ead-2bbb-41d3-a6ce-efb4e0885c85">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:         <nova:port uuid="680b6bd7-ed4c-46c1-ac8c-4fc537e11894">
Nov 15 01:15:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 01:15:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:09 user nova-compute[74880]:       </nova:ports>
Nov 15 01:15:09 user nova-compute[74880]:     </nova:instance>
Nov 15 01:15:09 user nova-compute[74880]:   </metadata>
Nov 15 01:15:09 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:15:09 user nova-compute[74880]:     <system>
Nov 15 01:15:09 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:15:09 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:15:09 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:15:09 user nova-compute[74880]:       <entry name="serial">dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9</entry>
Nov 15 01:15:09 user nova-compute[74880]:       <entry name="uuid">dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9</entry>
Nov 15 01:15:09 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:15:09 user nova-compute[74880]:     </system>
Nov 15 01:15:09 user nova-compute[74880]:   </sysinfo>
Nov 15 01:15:09 user nova-compute[74880]:   <os>
Nov 15 01:15:09 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:15:09 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:15:09 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:15:09 user nova-compute[74880]:   </os>
Nov 15 01:15:09 user nova-compute[74880]:   <features>
Nov 15 01:15:09 user nova-compute[74880]:     <acpi/>
Nov 15 01:15:09 user nova-compute[74880]:     <apic/>
Nov 15 01:15:09 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:15:09 user nova-compute[74880]:   </features>
Nov 15 01:15:09 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:15:09 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:15:09 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:15:09 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:15:09 user nova-compute[74880]:   </clock>
Nov 15 01:15:09 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:15:09 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:15:09 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:15:09 user nova-compute[74880]:   </cpu>
Nov 15 01:15:09 user nova-compute[74880]:   <devices>
Nov 15 01:15:09 user nova-compute[74880]:     <disk type="file" device="cdrom">
Nov 15 01:15:09 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 01:15:09 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9/disk.config"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="hda" bus="ide"/>
Nov 15 01:15:09 user nova-compute[74880]:     </disk>
Nov 15 01:15:09 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:15:09 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:09 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <serial>7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52</serial>
Nov 15 01:15:09 user nova-compute[74880]:     </disk>
Nov 15 01:15:09 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:15:09 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:09 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <serial>62b36c2b-8af5-40a0-9f16-bde131eda69d</serial>
Nov 15 01:15:09 user nova-compute[74880]:     </disk>
Nov 15 01:15:09 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:15:09 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:09 user nova-compute[74880]:       <source dev="/dev/sdf"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="vdc" bus="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <serial>78debe92-ae27-48c9-be7c-9525e8548e9c</serial>
Nov 15 01:15:09 user nova-compute[74880]:     </disk>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:f1:32:4b"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tap65bd5242-7d"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:22:19:ea"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tapa1345ad0-2b"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:d7:47:48"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tapf3bbc7b6-fa"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:24:7b:f7"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tapf4533027-a6"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:5c:e3:fd"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tap37702930-fa"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:55:4c:a7"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tap80fb2ead-2b"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:09 user nova-compute[74880]:       <mac address="fa:16:3e:30:ce:e9"/>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:09 user nova-compute[74880]:       <target dev="tap680b6bd7-ed"/>
Nov 15 01:15:09 user nova-compute[74880]:     </interface>
Nov 15 01:15:09 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:15:09 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9/console.log" append="off"/>
Nov 15 01:15:09 user nova-compute[74880]:     </serial>
Nov 15 01:15:09 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:15:09 user nova-compute[74880]:     <video>
Nov 15 01:15:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:09 user nova-compute[74880]:     </video>
Nov 15 01:15:09 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:15:09 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:15:09 user nova-compute[74880]:     </rng>
Nov 15 01:15:09 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:15:09 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:15:09 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:15:09 user nova-compute[74880]:     </memballoon>
Nov 15 01:15:09 user nova-compute[74880]:   </devices>
Nov 15 01:15:09 user nova-compute[74880]: </domain>
Nov 15 01:15:09 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7f87a3f-ed2d-501d-9424-0357fe9ed59f', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae7fb2-0a94-4de2-a85f-07006b5ac2a7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65bd5242-7d, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65bd5242-7d, col_values=(('qos', UUID('6fdc6668-5fb0-42c7-804a-0c79604d1f98')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65bd5242-7d, col_values=(('external_ids', {'iface-id': '65bd5242-7df3-407c-b280-752f322cd1e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:32:4b', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d')
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a011fd-ac2b-4fe7-85cc-b48ced3dbf83]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60b88542-6d18-5ffb-8dd1-2edaec30b601', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTbsexLG {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1345ad0-2b, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1345ad0-2b, col_values=(('qos', UUID('8b1c3b62-5f28-40bc-a45f-e05e5e4bd9fa')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1345ad0-2b, col_values=(('external_ids', {'iface-id': 'a1345ad0-2bcd-4bdb-bcac-645d7b498f81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:19:ea', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTbsexLG" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cb7eee-048e-4c20-91cb-182fd5604267]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CTbsexLG'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b')
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[996258b5-d0b7-4bd8-aaba-93cbd2ab01e3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55efec41-64e9-5717-baf5-1e568c2aec34', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3bbc7b6-fa, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3bbc7b6-fa, col_values=(('qos', UUID('fd022072-41ab-4fc9-8b55-749fa00bd476')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3bbc7b6-fa, col_values=(('external_ids', {'iface-id': 'f3bbc7b6-fa80-4857-a289-8690cd7bafdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:47:48', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ccce2-6c59-4954-894c-9a947b6d1595]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa')
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2318a65-8667-56dd-b4c5-9d61be737d78', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4533027-a6, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4533027-a6, col_values=(('qos', UUID('5b537827-44c5-40d0-a88f-79948f48ca3f')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4533027-a6, col_values=(('external_ids', {'iface-id': 'f4533027-a664-41c8-8206-71edcee4601b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:7b:f7', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd195fa-ff09-4362-b09f-dee8969e5b13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260]
Nov 15 01:15:10 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3911d3-5aa8-4a7a-8591-97efdd6ec178]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6')
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de2ccc59-2dcf-5540-9b52-edc8b7368019', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3022afcc-fcbf-4773-bd08-b66518261941]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:10 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:15:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d90726-e34a-43bd-9213-66c9b3a11db7]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTbsexLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37702930-fa, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37702930-fa, col_values=(('qos', UUID('daaa0e8d-f3ae-42ac-ba6e-3ca55e6afb96')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37702930-fa, col_values=(('external_ids', {'iface-id': '37702930-fabc-4f04-b5c5-5bc31ea04af3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:e3:fd', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa')
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6efbf010-8e62-59fa-b70e-a0496697603e', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80fb2ead-2b, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80fb2ead-2b, col_values=(('qos', UUID('6cfd5bbb-617b-46c0-8e55-8bfbf9b67af8')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80fb2ead-2b, col_values=(('external_ids', {'iface-id': '80fb2ead-2bbb-41d3-a6ce-efb4e0885c85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:4c:a7', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b')
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '325f163e-5f36-52d7-aded-c8d87cea01df', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap680b6bd7-ed, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap680b6bd7-ed, col_values=(('qos', UUID('517f1b98-7158-40b8-91de-fd78ca02ec23')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap680b6bd7-ed, col_values=(('external_ids', {'iface-id': '680b6bd7-ed4c-46c1-ac8c-4fc537e11894', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:ce:e9', 'vm-uuid': 'dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: INFO os_vif [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed')
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] No BDM found with device name hda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] No VIF found with MAC fa:16:3e:f1:32:4b, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] No VIF found with MAC fa:16:3e:5c:e3:fd, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Using config drive
Nov 15 01:15:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Creating config drive at /opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9/disk.config
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpey78w8j5 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpey78w8j5" returned: 0 in 0.065s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== connect_volume: return (2671ms) {'type': 'block', 'scsi_wwn': '23736313361306632', 'path': '/dev/sdg'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736313361306632', 'path': '/dev/sdg'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lazy-loading 'pci_devices' on Instance uuid 23781762-45a9-4943-b18e-19f6b8784e32 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:15:11 user nova-compute[74880]:   <uuid>23781762-45a9-4943-b18e-19f6b8784e32</uuid>
Nov 15 01:15:11 user nova-compute[74880]:   <name>instance-0000000c</name>
Nov 15 01:15:11 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:15:11 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:15:11 user nova-compute[74880]:   <metadata>
Nov 15 01:15:11 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:15:11 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:15:11 user nova-compute[74880]:       <nova:name>tempest-device-tagging-server-961652747</nova:name>
Nov 15 01:15:11 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:15:03</nova:creationTime>
Nov 15 01:15:11 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:15:11 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:15:11 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:15:11 user nova-compute[74880]:       <nova:owner>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:user uuid="59df6ca8a4b548ada0802c33cf9d6b11">tempest-TaggedBootDevicesTest-211578276-project-member</nova:user>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:project uuid="0439938f3f1c4f349e26159daa0d3e5e">tempest-TaggedBootDevicesTest-211578276</nova:project>
Nov 15 01:15:11 user nova-compute[74880]:       </nova:owner>
Nov 15 01:15:11 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:15:11 user nova-compute[74880]:       <nova:ports>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="ce77ed63-bd1b-4c4d-8c7f-80f142cad54b">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="dbb433bd-a744-47b9-96d6-13d96cd28aab">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="8f45863a-e5c2-4e68-8148-0fc88358f378">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="51ae329b-195b-49ca-b783-2a16649b2776">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.194" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="2991e3ac-7594-43bd-aa53-f63a10d89df2">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.1.1.169" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="b346fb6d-f804-4286-9f11-4796d62b50d5">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:         <nova:port uuid="a3e38161-fe09-4747-af12-b673abc3b159">
Nov 15 01:15:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 01:15:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:11 user nova-compute[74880]:       </nova:ports>
Nov 15 01:15:11 user nova-compute[74880]:     </nova:instance>
Nov 15 01:15:11 user nova-compute[74880]:   </metadata>
Nov 15 01:15:11 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:15:11 user nova-compute[74880]:     <system>
Nov 15 01:15:11 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:15:11 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:15:11 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:15:11 user nova-compute[74880]:       <entry name="serial">23781762-45a9-4943-b18e-19f6b8784e32</entry>
Nov 15 01:15:11 user nova-compute[74880]:       <entry name="uuid">23781762-45a9-4943-b18e-19f6b8784e32</entry>
Nov 15 01:15:11 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:15:11 user nova-compute[74880]:     </system>
Nov 15 01:15:11 user nova-compute[74880]:   </sysinfo>
Nov 15 01:15:11 user nova-compute[74880]:   <os>
Nov 15 01:15:11 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:15:11 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:15:11 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:15:11 user nova-compute[74880]:   </os>
Nov 15 01:15:11 user nova-compute[74880]:   <features>
Nov 15 01:15:11 user nova-compute[74880]:     <acpi/>
Nov 15 01:15:11 user nova-compute[74880]:     <apic/>
Nov 15 01:15:11 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:15:11 user nova-compute[74880]:   </features>
Nov 15 01:15:11 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:15:11 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:15:11 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:15:11 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:15:11 user nova-compute[74880]:   </clock>
Nov 15 01:15:11 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:15:11 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:15:11 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:15:11 user nova-compute[74880]:   </cpu>
Nov 15 01:15:11 user nova-compute[74880]:   <devices>
Nov 15 01:15:11 user nova-compute[74880]:     <disk type="file" device="cdrom">
Nov 15 01:15:11 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 01:15:11 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32/disk.config"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="hda" bus="ide"/>
Nov 15 01:15:11 user nova-compute[74880]:     </disk>
Nov 15 01:15:11 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:15:11 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:11 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <serial>23be2835-cba7-444f-8f02-60d73e3f0f51</serial>
Nov 15 01:15:11 user nova-compute[74880]:     </disk>
Nov 15 01:15:11 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:15:11 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:11 user nova-compute[74880]:       <source dev="/dev/sde"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <serial>9a49ba88-9eb9-4158-8247-996de5791ae1</serial>
Nov 15 01:15:11 user nova-compute[74880]:     </disk>
Nov 15 01:15:11 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:15:11 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:11 user nova-compute[74880]:       <source dev="/dev/sdg"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="vdc" bus="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <serial>01445dba-22e1-47d2-837c-6bb3165c6fb8</serial>
Nov 15 01:15:11 user nova-compute[74880]:     </disk>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:b4:82:44"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tapce77ed63-bd"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:6a:1a:0d"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tapdbb433bd-a7"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:86:a1:e6"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tap8f45863a-e5"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:c8:7d:28"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tap51ae329b-19"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:25:67:89"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tap2991e3ac-75"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:27:61:71"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tapb346fb6d-f8"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:11 user nova-compute[74880]:       <mac address="fa:16:3e:c7:75:41"/>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:11 user nova-compute[74880]:       <target dev="tapa3e38161-fe"/>
Nov 15 01:15:11 user nova-compute[74880]:     </interface>
Nov 15 01:15:11 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:15:11 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32/console.log" append="off"/>
Nov 15 01:15:11 user nova-compute[74880]:     </serial>
Nov 15 01:15:11 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:15:11 user nova-compute[74880]:     <video>
Nov 15 01:15:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:11 user nova-compute[74880]:     </video>
Nov 15 01:15:11 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:15:11 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:15:11 user nova-compute[74880]:     </rng>
Nov 15 01:15:11 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:15:11 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:15:11 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:15:11 user nova-compute[74880]:     </memballoon>
Nov 15 01:15:11 user nova-compute[74880]:   </devices>
Nov 15 01:15:11 user nova-compute[74880]: </domain>
Nov 15 01:15:11 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73935277-ba6c-52bc-87f9-d3f5a2efb040', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce77ed63-bd, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce77ed63-bd, col_values=(('qos', UUID('2d834168-5d7a-414a-9ef4-342fd2be0667')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce77ed63-bd, col_values=(('external_ids', {'iface-id': 'ce77ed63-bd1b-4c4d-8c7f-80f142cad54b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:82:44', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd')
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d352bcc-5a14-593c-a553-ff9cf2202532', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb433bd-a7, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbb433bd-a7, col_values=(('qos', UUID('48ba0022-3659-489c-9e3f-472eb38724a2')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbb433bd-a7, col_values=(('external_ids', {'iface-id': 'dbb433bd-a744-47b9-96d6-13d96cd28aab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:1a:0d', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7')
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf016a18-7309-543b-9b35-e75ada04707e', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f45863a-e5, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f45863a-e5, col_values=(('qos', UUID('4c8236f8-0109-4213-a15d-862d828377a3')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f45863a-e5, col_values=(('external_ids', {'iface-id': '8f45863a-e5c2-4e68-8148-0fc88358f378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:a1:e6', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5')
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9717393-c911-5dac-b81f-c91c54966a4d', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ae329b-19, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ae329b-19, col_values=(('qos', UUID('9207f392-ff06-4326-a560-d51263e8c54e')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ae329b-19, col_values=(('external_ids', {'iface-id': '51ae329b-195b-49ca-b783-2a16649b2776', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:7d:28', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19')
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be920f5d-a0ed-55e1-b66b-90003ed46a3c', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2991e3ac-75, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2991e3ac-75, col_values=(('qos', UUID('bf620875-9f51-4a2a-a0aa-3bc96e508da6')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2991e3ac-75, col_values=(('external_ids', {'iface-id': '2991e3ac-7594-43bd-aa53-f63a10d89df2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:67:89', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75')
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b6184ea-f6e5-556a-96e3-858881a0d51e', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb346fb6d-f8, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb346fb6d-f8, col_values=(('qos', UUID('c7b7bf44-83f6-4993-b09b-b53d804d2467')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb346fb6d-f8, col_values=(('external_ids', {'iface-id': 'b346fb6d-f804-4286-9f11-4796d62b50d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:61:71', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8')
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc504fca-fb09-5b74-a786-0617801120e0', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3e38161-fe, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3e38161-fe, col_values=(('qos', UUID('d14cbbc5-c623-49dc-974f-73cffbc40946')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3e38161-fe, col_values=(('external_ids', {'iface-id': 'a3e38161-fe09-4747-af12-b673abc3b159', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:75:41', 'vm-uuid': '23781762-45a9-4943-b18e-19f6b8784e32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: INFO os_vif [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe')
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] No BDM found with device name hda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] No VIF found with MAC fa:16:3e:b4:82:44, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] No VIF found with MAC fa:16:3e:25:67:89, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Using config drive
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Creating config drive at /opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32/disk.config
Nov 15 01:15:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt5nu1pmd {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt5nu1pmd" returned: 0 in 0.056s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-a55c2ed4-8c56-4837-8393-ac1f0857c3e8 req-4c3304f3-81f7-4075-bd63-a2a3c76f8a2f service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a55c2ed4-8c56-4837-8393-ac1f0857c3e8 req-4c3304f3-81f7-4075-bd63-a2a3c76f8a2f service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a55c2ed4-8c56-4837-8393-ac1f0857c3e8 req-4c3304f3-81f7-4075-bd63-a2a3c76f8a2f service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a55c2ed4-8c56-4837-8393-ac1f0857c3e8 req-4c3304f3-81f7-4075-bd63-a2a3c76f8a2f service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-a55c2ed4-8c56-4837-8393-ac1f0857c3e8 req-4c3304f3-81f7-4075-bd63-a2a3c76f8a2f service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:13 user nova-compute[74880]: WARNING nova.compute.manager [req-a55c2ed4-8c56-4837-8393-ac1f0857c3e8 req-4c3304f3-81f7-4075-bd63-a2a3c76f8a2f service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 for instance with vm_state building and task_state spawning.
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-ceef41fe-8b70-4824-9236-f7f080213d52 req-4ac5d4db-5a57-4955-8c37-4ee04f8ec84e service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ceef41fe-8b70-4824-9236-f7f080213d52 req-4ac5d4db-5a57-4955-8c37-4ee04f8ec84e service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ceef41fe-8b70-4824-9236-f7f080213d52 req-4ac5d4db-5a57-4955-8c37-4ee04f8ec84e service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ceef41fe-8b70-4824-9236-f7f080213d52 req-4ac5d4db-5a57-4955-8c37-4ee04f8ec84e service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-ceef41fe-8b70-4824-9236-f7f080213d52 req-4ac5d4db-5a57-4955-8c37-4ee04f8ec84e service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:14 user nova-compute[74880]: WARNING nova.compute.manager [req-ceef41fe-8b70-4824-9236-f7f080213d52 req-4ac5d4db-5a57-4955-8c37-4ee04f8ec84e service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b for instance with vm_state building and task_state spawning.
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:15 user nova-compute[74880]: WARNING nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 for instance with vm_state building and task_state spawning.
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:15 user nova-compute[74880]: WARNING nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 for instance with vm_state building and task_state spawning.
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:15 user nova-compute[74880]: WARNING nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 for instance with vm_state building and task_state spawning.
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:15 user nova-compute[74880]: WARNING nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc for instance with vm_state building and task_state spawning.
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:15 user nova-compute[74880]: WARNING nova.compute.manager [req-97bd4d34-4d7d-4f4e-916f-0755e2c234e5 req-17111537-7d9b-4520-82f6-79af8c60998a service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc for instance with vm_state building and task_state spawning.
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-29a23fb6-89ed-432c-9dd8-cdb91950c263 req-c286a638-5d6e-42cf-9960-493304b71752 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-29a23fb6-89ed-432c-9dd8-cdb91950c263 req-c286a638-5d6e-42cf-9960-493304b71752 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-29a23fb6-89ed-432c-9dd8-cdb91950c263 req-c286a638-5d6e-42cf-9960-493304b71752 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-29a23fb6-89ed-432c-9dd8-cdb91950c263 req-c286a638-5d6e-42cf-9960-493304b71752 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-29a23fb6-89ed-432c-9dd8-cdb91950c263 req-c286a638-5d6e-42cf-9960-493304b71752 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:15 user nova-compute[74880]: WARNING nova.compute.manager [req-29a23fb6-89ed-432c-9dd8-cdb91950c263 req-c286a638-5d6e-42cf-9960-493304b71752 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 for instance with vm_state building and task_state spawning.
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-cda08c74-7311-4ea1-a60e-20d858ee16d9 req-afa1a254-cb86-4b86-9f29-de4d0e50348c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cda08c74-7311-4ea1-a60e-20d858ee16d9 req-afa1a254-cb86-4b86-9f29-de4d0e50348c service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cda08c74-7311-4ea1-a60e-20d858ee16d9 req-afa1a254-cb86-4b86-9f29-de4d0e50348c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cda08c74-7311-4ea1-a60e-20d858ee16d9 req-afa1a254-cb86-4b86-9f29-de4d0e50348c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-cda08c74-7311-4ea1-a60e-20d858ee16d9 req-afa1a254-cb86-4b86-9f29-de4d0e50348c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:16 user nova-compute[74880]: WARNING nova.compute.manager [req-cda08c74-7311-4ea1-a60e-20d858ee16d9 req-afa1a254-cb86-4b86-9f29-de4d0e50348c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b for instance with vm_state building and task_state spawning.
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-16513f5d-97b7-466b-b20f-10bb1b129031 req-bbd1c2fc-e3f6-470a-8ddc-76283bb4d48c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:17 user nova-compute[74880]: WARNING nova.compute.manager [req-1c39d064-61cb-4432-8cc9-c6c75099731e req-4ca00c24-00ff-4b91-a9bd-919f98cf3346 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 for instance with vm_state building and task_state spawning.
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:18 user nova-compute[74880]: WARNING nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 for instance with vm_state building and task_state spawning.
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:18 user nova-compute[74880]: WARNING nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 for instance with vm_state building and task_state spawning.
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:18 user nova-compute[74880]: WARNING nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 for instance with vm_state building and task_state spawning.
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:18 user nova-compute[74880]: WARNING nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 for instance with vm_state building and task_state spawning.
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:18 user nova-compute[74880]: WARNING nova.compute.manager [req-f4c780fc-50cf-41e2-8927-f5d18a040a45 req-70adca6b-7ca3-4e10-9346-d8e858bc91e0 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 for instance with vm_state building and task_state spawning.
Nov 15 01:15:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:19 user nova-compute[74880]: WARNING nova.compute.manager [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 for instance with vm_state building and task_state spawning.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:19 user nova-compute[74880]: WARNING nova.compute.manager [req-5996437a-9db0-4a74-9685-e50478245c61 req-67abc300-5b44-4afa-9732-41c584e22042 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 for instance with vm_state building and task_state spawning.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:19 user nova-compute[74880]: WARNING nova.compute.manager [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 for instance with vm_state building and task_state spawning.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:19 user nova-compute[74880]: WARNING nova.compute.manager [req-042f63f2-717a-4730-af75-1a653aa4195d req-4d821fbf-f336-42ee-b9d5-2744a9c83227 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 for instance with vm_state building and task_state spawning.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:15:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance spawned successfully.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:19 user nova-compute[74880]: INFO nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Took 16.78 seconds to spawn the instance on the hypervisor.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:15:19 user nova-compute[74880]: INFO nova.compute.manager [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Took 37.14 seconds to build instance.
Nov 15 01:15:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a4e682f9-1daf-4ed2-b8c6-cfeb463b899b tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.296s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-09a2e949-4a6f-46ca-8e59-fbf509129ae6 req-7cdf3688-d0eb-449c-a05f-601f20fd59af service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09a2e949-4a6f-46ca-8e59-fbf509129ae6 req-7cdf3688-d0eb-449c-a05f-601f20fd59af service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09a2e949-4a6f-46ca-8e59-fbf509129ae6 req-7cdf3688-d0eb-449c-a05f-601f20fd59af service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09a2e949-4a6f-46ca-8e59-fbf509129ae6 req-7cdf3688-d0eb-449c-a05f-601f20fd59af service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-09a2e949-4a6f-46ca-8e59-fbf509129ae6 req-7cdf3688-d0eb-449c-a05f-601f20fd59af service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:20 user nova-compute[74880]: WARNING nova.compute.manager [req-09a2e949-4a6f-46ca-8e59-fbf509129ae6 req-7cdf3688-d0eb-449c-a05f-601f20fd59af service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 for instance with vm_state building and task_state spawning.
Nov 15 01:15:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:15:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:15:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance spawned successfully.
Nov 15 01:15:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:21 user nova-compute[74880]: INFO nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Took 17.43 seconds to spawn the instance on the hypervisor.
Nov 15 01:15:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:15:21 user nova-compute[74880]: INFO nova.compute.manager [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Took 35.41 seconds to build instance.
Nov 15 01:15:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-94c3e6d4-ea81-452f-9fff-9b7c656ed49a tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "23781762-45a9-4943-b18e-19f6b8784e32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.521s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:29 user nova-compute[74880]: INFO nova.compute.manager [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Rescuing
Nov 15 01:15:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:29 user nova-compute[74880]: DEBUG nova.network.neutron [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.network.neutron [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:15:30 user nova-compute[74880]: INFO nova.compute.claims [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Claim successful on node user
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-45b408a9-219b-49e7-9707-97d82d3d1243 req-c38fc65a-9217-41a2-b1d7-9a131ede141a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-unplugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-45b408a9-219b-49e7-9707-97d82d3d1243 req-c38fc65a-9217-41a2-b1d7-9a131ede141a service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-45b408a9-219b-49e7-9707-97d82d3d1243 req-c38fc65a-9217-41a2-b1d7-9a131ede141a service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-45b408a9-219b-49e7-9707-97d82d3d1243 req-c38fc65a-9217-41a2-b1d7-9a131ede141a service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-45b408a9-219b-49e7-9707-97d82d3d1243 req-c38fc65a-9217-41a2-b1d7-9a131ede141a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-unplugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:30 user nova-compute[74880]: WARNING nova.compute.manager [req-45b408a9-219b-49e7-9707-97d82d3d1243 req-c38fc65a-9217-41a2-b1d7-9a131ede141a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-unplugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state active and task_state rescuing.
Nov 15 01:15:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance destroyed successfully.
Nov 15 01:15:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Attempting rescue
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74880) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:15:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Creating image(s)
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.249s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue" returned: 0 in 0.048s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'migration_context' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.base [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<fc9fe17c-b782-44d0-8adc-3c42fde5af94> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Start _get_guest_xml network_info=[{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:87:e8:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'resources' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.base [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<fc9fe17c-b782-44d0-8adc-3c42fde5af94> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'numa_topology' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.base [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<fc9fe17c-b782-44d0-8adc-3c42fde5af94> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.945s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:15:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.base [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<fc9fe17c-b782-44d0-8adc-3c42fde5af94> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737312131',display_name='tempest-ServerRescueNegativeTestJSON-server-1737312131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737312131',id=2,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-ja26cgna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:55Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=fc9fe17c-b782-44d0-8adc-3c42fde5af94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:87:e8:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:87:e8:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.objects.base [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<fc9fe17c-b782-44d0-8adc-3c42fde5af94> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:15:31 user nova-compute[74880]:   <uuid>fc9fe17c-b782-44d0-8adc-3c42fde5af94</uuid>
Nov 15 01:15:31 user nova-compute[74880]:   <name>instance-00000002</name>
Nov 15 01:15:31 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:15:31 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:15:31 user nova-compute[74880]:   <metadata>
Nov 15 01:15:31 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:15:31 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:15:31 user nova-compute[74880]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1737312131</nova:name>
Nov 15 01:15:31 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:15:31</nova:creationTime>
Nov 15 01:15:31 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:15:31 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:15:31 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:15:31 user nova-compute[74880]:       <nova:owner>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:user uuid="7c88b23d691c4cdc98757d0af8ab27c1">tempest-ServerRescueNegativeTestJSON-1212122190-project-member</nova:user>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:project uuid="d96e59bffc2b4c99940e4c87ad82521e">tempest-ServerRescueNegativeTestJSON-1212122190</nova:project>
Nov 15 01:15:31 user nova-compute[74880]:       </nova:owner>
Nov 15 01:15:31 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:15:31 user nova-compute[74880]:       <nova:ports>
Nov 15 01:15:31 user nova-compute[74880]:         <nova:port uuid="e9b027ca-99e0-44f7-9658-785628855901">
Nov 15 01:15:31 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:15:31 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:31 user nova-compute[74880]:       </nova:ports>
Nov 15 01:15:31 user nova-compute[74880]:     </nova:instance>
Nov 15 01:15:31 user nova-compute[74880]:   </metadata>
Nov 15 01:15:31 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:15:31 user nova-compute[74880]:     <system>
Nov 15 01:15:31 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:15:31 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:15:31 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:15:31 user nova-compute[74880]:       <entry name="serial">fc9fe17c-b782-44d0-8adc-3c42fde5af94</entry>
Nov 15 01:15:31 user nova-compute[74880]:       <entry name="uuid">fc9fe17c-b782-44d0-8adc-3c42fde5af94</entry>
Nov 15 01:15:31 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:15:31 user nova-compute[74880]:     </system>
Nov 15 01:15:31 user nova-compute[74880]:   </sysinfo>
Nov 15 01:15:31 user nova-compute[74880]:   <os>
Nov 15 01:15:31 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:15:31 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:15:31 user nova-compute[74880]:   </os>
Nov 15 01:15:31 user nova-compute[74880]:   <features>
Nov 15 01:15:31 user nova-compute[74880]:     <acpi/>
Nov 15 01:15:31 user nova-compute[74880]:     <apic/>
Nov 15 01:15:31 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:15:31 user nova-compute[74880]:   </features>
Nov 15 01:15:31 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:15:31 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:15:31 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:15:31 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:15:31 user nova-compute[74880]:   </clock>
Nov 15 01:15:31 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:15:31 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:15:31 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:15:31 user nova-compute[74880]:   </cpu>
Nov 15 01:15:31 user nova-compute[74880]:   <devices>
Nov 15 01:15:31 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:15:31 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:15:31 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue"/>
Nov 15 01:15:31 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:15:31 user nova-compute[74880]:     </disk>
Nov 15 01:15:31 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:15:31 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:15:31 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk"/>
Nov 15 01:15:31 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:15:31 user nova-compute[74880]:     </disk>
Nov 15 01:15:31 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:31 user nova-compute[74880]:       <mac address="fa:16:3e:87:e8:d3"/>
Nov 15 01:15:31 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:31 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:31 user nova-compute[74880]:       <target dev="tape9b027ca-99"/>
Nov 15 01:15:31 user nova-compute[74880]:     </interface>
Nov 15 01:15:31 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:15:31 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/console.log" append="off"/>
Nov 15 01:15:31 user nova-compute[74880]:     </serial>
Nov 15 01:15:31 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:15:31 user nova-compute[74880]:     <video>
Nov 15 01:15:31 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:31 user nova-compute[74880]:     </video>
Nov 15 01:15:31 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:15:31 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:15:31 user nova-compute[74880]:     </rng>
Nov 15 01:15:31 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:15:31 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:15:31 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:15:31 user nova-compute[74880]:     </memballoon>
Nov 15 01:15:31 user nova-compute[74880]:   </devices>
Nov 15 01:15:31 user nova-compute[74880]: </domain>
Nov 15 01:15:31 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:15:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:15:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance destroyed successfully.
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:87:e8:d3, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.policy [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9de13732bcf04ab98686accb51cd4af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b89fc20cea474b93164a63cbc4c3e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:15:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Creating image(s)
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "/opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "/opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.221s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk 1073741824" returned: 0 in 0.062s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-af11de87-cc70-4e33-bb52-729b3153721a req-fb2b55ba-4328-4135-aa79-ee5f13346203 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-af11de87-cc70-4e33-bb52-729b3153721a req-fb2b55ba-4328-4135-aa79-ee5f13346203 service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-af11de87-cc70-4e33-bb52-729b3153721a req-fb2b55ba-4328-4135-aa79-ee5f13346203 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-af11de87-cc70-4e33-bb52-729b3153721a req-fb2b55ba-4328-4135-aa79-ee5f13346203 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-af11de87-cc70-4e33-bb52-729b3153721a req-fb2b55ba-4328-4135-aa79-ee5f13346203 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:32 user nova-compute[74880]: WARNING nova.compute.manager [req-af11de87-cc70-4e33-bb52-729b3153721a req-fb2b55ba-4328-4135-aa79-ee5f13346203 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state active and task_state rescuing.
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Successfully created port: 2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Cannot resize image /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Ensure instance console log exists: /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Successfully updated port: 2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "refresh_cache-d1cff7b2-c988-48d7-9649-ac1b7831ac7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquired lock "refresh_cache-d1cff7b2-c988-48d7-9649-ac1b7831ac7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-changed-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Refreshing instance network info cache due to event network-changed-2f604ee9-a0f9-49c2-827c-9ca6b905a34e. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] Acquiring lock "refresh_cache-d1cff7b2-c988-48d7-9649-ac1b7831ac7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Updating instance_info_cache with network_info: [{"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Releasing lock "refresh_cache-d1cff7b2-c988-48d7-9649-ac1b7831ac7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Instance network_info: |[{"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] Acquired lock "refresh_cache-d1cff7b2-c988-48d7-9649-ac1b7831ac7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Refreshing network info cache for port 2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:15:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Start _get_guest_xml network_info=[{"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:15:34 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:34 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-926616564',display_name='tempest-ServersNegativeTestJSON-server-926616564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-926616564',id=13,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b89fc20cea474b93164a63cbc4c3e4',ramdisk_id='',reservation_id='r-zf2aduen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657617311',owner_user_name='tempest-ServersNegativeTestJSON-1657617311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:15:32Z,user_data=None,user_id='9de13732bcf04ab98686accb51cd4af4',uuid=d1cff7b2-c988-48d7-9649-ac1b7831ac7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converting VIF {"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.objects.instance [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lazy-loading 'pci_devices' on Instance uuid d1cff7b2-c988-48d7-9649-ac1b7831ac7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:15:34 user nova-compute[74880]:   <uuid>d1cff7b2-c988-48d7-9649-ac1b7831ac7f</uuid>
Nov 15 01:15:34 user nova-compute[74880]:   <name>instance-0000000d</name>
Nov 15 01:15:34 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:15:34 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:15:34 user nova-compute[74880]:   <metadata>
Nov 15 01:15:34 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:15:34 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:15:34 user nova-compute[74880]:       <nova:name>tempest-ServersNegativeTestJSON-server-926616564</nova:name>
Nov 15 01:15:34 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:15:34</nova:creationTime>
Nov 15 01:15:34 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:15:34 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:15:34 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:15:34 user nova-compute[74880]:       <nova:owner>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:user uuid="9de13732bcf04ab98686accb51cd4af4">tempest-ServersNegativeTestJSON-1657617311-project-member</nova:user>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:project uuid="20b89fc20cea474b93164a63cbc4c3e4">tempest-ServersNegativeTestJSON-1657617311</nova:project>
Nov 15 01:15:34 user nova-compute[74880]:       </nova:owner>
Nov 15 01:15:34 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:15:34 user nova-compute[74880]:       <nova:ports>
Nov 15 01:15:34 user nova-compute[74880]:         <nova:port uuid="2f604ee9-a0f9-49c2-827c-9ca6b905a34e">
Nov 15 01:15:34 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:15:34 user nova-compute[74880]:         </nova:port>
Nov 15 01:15:34 user nova-compute[74880]:       </nova:ports>
Nov 15 01:15:34 user nova-compute[74880]:     </nova:instance>
Nov 15 01:15:34 user nova-compute[74880]:   </metadata>
Nov 15 01:15:34 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:15:34 user nova-compute[74880]:     <system>
Nov 15 01:15:34 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:15:34 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:15:34 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:15:34 user nova-compute[74880]:       <entry name="serial">d1cff7b2-c988-48d7-9649-ac1b7831ac7f</entry>
Nov 15 01:15:34 user nova-compute[74880]:       <entry name="uuid">d1cff7b2-c988-48d7-9649-ac1b7831ac7f</entry>
Nov 15 01:15:34 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:15:34 user nova-compute[74880]:     </system>
Nov 15 01:15:34 user nova-compute[74880]:   </sysinfo>
Nov 15 01:15:34 user nova-compute[74880]:   <os>
Nov 15 01:15:34 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:15:34 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:15:34 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:15:34 user nova-compute[74880]:   </os>
Nov 15 01:15:34 user nova-compute[74880]:   <features>
Nov 15 01:15:34 user nova-compute[74880]:     <acpi/>
Nov 15 01:15:34 user nova-compute[74880]:     <apic/>
Nov 15 01:15:34 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:15:34 user nova-compute[74880]:   </features>
Nov 15 01:15:34 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:15:34 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:15:34 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:15:34 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:15:34 user nova-compute[74880]:   </clock>
Nov 15 01:15:34 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:15:34 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:15:34 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:15:34 user nova-compute[74880]:   </cpu>
Nov 15 01:15:34 user nova-compute[74880]:   <devices>
Nov 15 01:15:34 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:15:34 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:15:34 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk"/>
Nov 15 01:15:34 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:15:34 user nova-compute[74880]:     </disk>
Nov 15 01:15:34 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:15:34 user nova-compute[74880]:       <mac address="fa:16:3e:1b:21:a7"/>
Nov 15 01:15:34 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:34 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:15:34 user nova-compute[74880]:       <target dev="tap2f604ee9-a0"/>
Nov 15 01:15:34 user nova-compute[74880]:     </interface>
Nov 15 01:15:34 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:15:34 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/console.log" append="off"/>
Nov 15 01:15:34 user nova-compute[74880]:     </serial>
Nov 15 01:15:34 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:15:34 user nova-compute[74880]:     <video>
Nov 15 01:15:34 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:15:34 user nova-compute[74880]:     </video>
Nov 15 01:15:34 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:15:34 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:15:34 user nova-compute[74880]:     </rng>
Nov 15 01:15:34 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:15:34 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:15:34 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:15:34 user nova-compute[74880]:     </memballoon>
Nov 15 01:15:34 user nova-compute[74880]:   </devices>
Nov 15 01:15:34 user nova-compute[74880]: </domain>
Nov 15 01:15:34 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-926616564',display_name='tempest-ServersNegativeTestJSON-server-926616564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-926616564',id=13,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b89fc20cea474b93164a63cbc4c3e4',ramdisk_id='',reservation_id='r-zf2aduen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657617311',owner_user_name='tempest-ServersNegativeTestJSON-1657617311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:15:32Z,user_data=None,user_id='9de13732bcf04ab98686accb51cd4af4',uuid=d1cff7b2-c988-48d7-9649-ac1b7831ac7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converting VIF {"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG os_vif [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '757eb2c0-715a-544a-af88-63dd2d91f105', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f604ee9-a0, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f604ee9-a0, col_values=(('qos', UUID('d782230f-a0dd-4e02-8524-c409e174c315')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f604ee9-a0, col_values=(('external_ids', {'iface-id': '2f604ee9-a0f9-49c2-827c-9ca6b905a34e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:21:a7', 'vm-uuid': 'd1cff7b2-c988-48d7-9649-ac1b7831ac7f'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:34 user nova-compute[74880]: INFO os_vif [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0')
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] No VIF found with MAC fa:16:3e:1b:21:a7, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Updated VIF entry in instance network info cache for port 2f604ee9-a0f9-49c2-827c-9ca6b905a34e. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Updating instance_info_cache with network_info: [{"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-73f5972b-2351-4563-8115-0c3dd459089f req-ec9543c4-61c6-4b27-9c56-afe00b2c61bf service nova] Releasing lock "refresh_cache-d1cff7b2-c988-48d7-9649-ac1b7831ac7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:34 user nova-compute[74880]: WARNING nova.compute.manager [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state active and task_state rescuing.
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:34 user nova-compute[74880]: WARNING nova.compute.manager [req-229e1112-5deb-4f85-b185-1a4f4bc1a38f req-907665d7-6602-40b1-8756-29c2d16ca11a service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state active and task_state rescuing.
Nov 15 01:15:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-73be909b-8476-4855-837b-2050421d7f1f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:15:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] No waiting events found dispatching network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:36 user nova-compute[74880]: WARNING nova.compute.manager [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received unexpected event network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e for instance with vm_state building and task_state spawning.
Nov 15 01:15:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] No waiting events found dispatching network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:15:36 user nova-compute[74880]: WARNING nova.compute.manager [req-91fce581-69ba-45cf-b8cd-f067630d62f6 req-ca0d12aa-79ff-4dc8-98c5-38313ccea185 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received unexpected event network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e for instance with vm_state building and task_state spawning.
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:15:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Instance spawned successfully.
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:15:37 user nova-compute[74880]: INFO nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 15 01:15:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:15:38 user nova-compute[74880]: INFO nova.compute.manager [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Took 7.65 seconds to build instance.
Nov 15 01:15:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-380ac932-5a5e-40f3-a97e-b7ec25162b95 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing instance network info cache due to event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:15:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:39 user nova-compute[74880]: DEBUG nova.network.neutron [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:15:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updated VIF entry in instance network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f999231e-fd24-4415-a28b-9c0dd755f06b req-bf894f2a-392b-4257-8ebf-3ba132232ecd service nova] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:15:40 user nova-compute[74880]: INFO nova.compute.manager [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] instance snapshotting
Nov 15 01:15:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Beginning live snapshot process
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-changed-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Refreshing instance network info cache due to event network-changed-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Refreshing network info cache for port dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json -f qcow2" returned: 0 in 0.225s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.212s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd7u1mhx3/ed86bd2dd87d4241a9f644b02c528de9.delta 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd7u1mhx3/ed86bd2dd87d4241a9f644b02c528de9.delta 1073741824" returned: 0 in 0.061s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74880) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 01:15:41 user nova-compute[74880]: INFO nova.virt.libvirt.host [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] UEFI support detected
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated VIF entry in instance network info cache for port dc4a6925-6a3f-47fc-a0df-0a77d9f5927b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e8b44d08-f9b1-4584-a0de-adb0f4b5f7c1 req-483636be-f482-4c00-b923-f5c46890e63a service nova] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:41 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:15:42 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 01:15:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd7u1mhx3/ed86bd2dd87d4241a9f644b02c528de9.delta /opt/stack/data/nova/instances/snapshots/tmpd7u1mhx3/ed86bd2dd87d4241a9f644b02c528de9 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd7u1mhx3/ed86bd2dd87d4241a9f644b02c528de9.delta /opt/stack/data/nova/instances/snapshots/tmpd7u1mhx3/ed86bd2dd87d4241a9f644b02c528de9" returned: 0 in 0.304s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Snapshot extracted, beginning image upload
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Snapshot image upload complete
Nov 15 01:15:46 user nova-compute[74880]: INFO nova.compute.manager [None req-d00281ef-d770-44c7-8d81-b92290aa52f7 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Took 5.96 seconds to snapshot the instance on the hypervisor.
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:48 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:48 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=6631MB free_disk=25.621746063232422GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance bc155ceb-d7ca-477b-8479-a459fa50af05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9866d0ef-d713-4601-b797-780abd5fb7af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ec08677b-c923-4307-855e-c6326dfedf6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8dbd7773-a064-47c0-926f-c12afcb24d7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 026890b4-5a76-4730-bc20-54b95359bdcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 23781762-45a9-4943-b18e-19f6b8784e32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d1cff7b2-c988-48d7-9649-ac1b7831ac7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:15:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:15:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:49 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:15:49 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:15:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:15:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.916s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-changed-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Refreshing instance network info cache due to event network-changed-904ecba4-3cc1-4872-9065-4b8923cdbc70. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] Acquiring lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] Acquired lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Refreshing network info cache for port 904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updated VIF entry in instance network info cache for port 904ecba4-3cc1-4872-9065-4b8923cdbc70. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updating instance_info_cache with network_info: [{"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e518dcbe-3a6c-4a9e-853c-eb891e375884 req-12845aa1-5d79-476a-9a0a-79c433d1e47a service nova] Releasing lock "refresh_cache-bc155ceb-d7ca-477b-8479-a459fa50af05" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:15:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'flavor' on Instance uuid bc155ceb-d7ca-477b-8479-a459fa50af05 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:15:52 user nova-compute[74880]: INFO nova.compute.manager [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Attaching volume 9652389d-9196-4091-802f-8de229165e1d to /dev/vdb
Nov 15 01:15:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7374fe-d65c-46fd-8c53-f8a64da6e68f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d26d5-8478-4b2a-b1fd-eb654ca1828a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4aed2-4ed2-4ae9-acfb-11f80e0135d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb4a103-dadb-4ace-a556-15f4bf1af0f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:15:52 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:15:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec13a329-4f92-4051-bc0d-6c49367d35a7]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:52 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updating existing volume attachment record: cec8acd1-2e2f-4788-8d06-36a01455cebf {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:15:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItDGbZCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:15:57 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:57 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:15:57 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7f80ca-f3f3-44b9-a4d6-265542eb79a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:15:57 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2cfc61-ddd0-46fb-b572-f9e9e22f6cd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d] added
Nov 15 01:15:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4915a34a-98ea-4888-af7c-d873c5822be7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c132d710-80a4-4d96-a3c3-459f325e5f06]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItDGbZCR {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItDGbZCR" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea0659d-e7cd-48ae-8c37-e22b22d11754]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItDGbZCR'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b46de5e-f709-47e3-9aff-c9e9bd34c260]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74054cf-ce89-4a8d-9bc6-13de2c3ea185]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f78475b-d1d0-4281-aeb5-e3cd00c7bc80 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f78475b-d1d0-4281-aeb5-e3cd00c7bc80 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f78475b-d1d0-4281-aeb5-e3cd00c7bc80 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f51386-1b76-4b64-86fe-935dd3d2a085]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260]
Nov 15 01:15:57 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260] successful.
Nov 15 01:15:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3e8ac-0df0-444f-b1e2-452897bd9f85]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2ee56-120d-4ad6-90f7-3f5d541dd2c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f78475b-d1d0-4281-aeb5-e3cd00c7bc80 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f78475b-d1d0-4281-aeb5-e3cd00c7bc80 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:15:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f78475b-d1d0-4281-aeb5-e3cd00c7bc80 (non-flash)
Nov 15 01:15:57 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:15:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f7642-c93d-4357-affc-a6e21518bf65]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:15:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItDGbZCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26238306238373233', 'path': '/dev/sdi'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238306238373233', 'path': '/dev/sdi'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG nova.objects.instance [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'flavor' on Instance uuid bc155ceb-d7ca-477b-8479-a459fa50af05 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:15:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:15:58 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:15:58 user nova-compute[74880]:   <source dev="/dev/sdi"/>
Nov 15 01:15:58 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:15:58 user nova-compute[74880]:   <serial>9652389d-9196-4091-802f-8de229165e1d</serial>
Nov 15 01:15:58 user nova-compute[74880]: </disk>
Nov 15 01:15:58 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No VIF found with MAC fa:16:3e:e1:8f:93, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-changed-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Refreshing instance network info cache due to event network-changed-d9bef030-7b06-4058-ab38-ae84ea0f34d1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] Acquiring lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] Acquired lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Refreshing network info cache for port d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-780cf4ce-fc7f-4e98-9c3a-180cf73a301d tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.172s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updated VIF entry in instance network info cache for port d9bef030-7b06-4058-ab38-ae84ea0f34d1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updating instance_info_cache with network_info: [{"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:15:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e84391c1-8708-4ad5-ad6a-dfb99202d427 req-118b177b-2bfb-4f51-98e4-1adeadaa5d2e service nova] Releasing lock "refresh_cache-9866d0ef-d713-4601-b797-780abd5fb7af" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:00 user nova-compute[74880]: INFO nova.compute.manager [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Detaching volume 9652389d-9196-4091-802f-8de229165e1d
Nov 15 01:16:00 user nova-compute[74880]: INFO nova.virt.block_device [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Attempting to driver detach volume 9652389d-9196-4091-802f-8de229165e1d from mountpoint /dev/vdb
Nov 15 01:16:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Attempting to detach device vdb from instance bc155ceb-d7ca-477b-8479-a459fa50af05 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:16:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:00 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:00 user nova-compute[74880]:   <source dev="/dev/sdi"/>
Nov 15 01:16:00 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:00 user nova-compute[74880]:   <serial>9652389d-9196-4091-802f-8de229165e1d</serial>
Nov 15 01:16:00 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:16:00 user nova-compute[74880]: </disk>
Nov 15 01:16:00 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Successfully detached device vdb from instance bc155ceb-d7ca-477b-8479-a459fa50af05 from the persistent domain config.
Nov 15 01:16:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc155ceb-d7ca-477b-8479-a459fa50af05 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:16:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:00 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:00 user nova-compute[74880]:   <source dev="/dev/sdi"/>
Nov 15 01:16:00 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:00 user nova-compute[74880]:   <serial>9652389d-9196-4091-802f-8de229165e1d</serial>
Nov 15 01:16:00 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:16:00 user nova-compute[74880]: </disk>
Nov 15 01:16:00 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc155ceb-d7ca-477b-8479-a459fa50af05 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lazy-loading 'flavor' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-changed-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Refreshing instance network info cache due to event network-changed-f33f0e62-8afe-4b3c-be48-26e9037c4193. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] Acquiring lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] Acquired lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Refreshing network info cache for port f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:01 user nova-compute[74880]: INFO nova.compute.manager [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Attaching volume b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 to /dev/vdb
Nov 15 01:16:01 user nova-compute[74880]: DEBUG os_brick.utils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[104cc786-504d-4d38-85a8-7618360a34b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1009fc-c845-496e-a578-4324a9ffd37a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b08b05-ecc6-4159-a370-59fcafad1d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf0e1da-7a80-43e4-a66c-0dc8a9ce42b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:01 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8f9af-9d34-4fdc-871d-9ac77c2b8018]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG os_brick.utils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updating existing volume attachment record: 709a70c8-ef0f-4f1d-ade1-45ab5cb93c60 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updated VIF entry in instance network info cache for port f33f0e62-8afe-4b3c-be48-26e9037c4193. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updating instance_info_cache with network_info: [{"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-24150f88-cd5e-4024-b4f7-ec52eddda467 req-74bfc4b1-96f6-4135-a4db-253a47bdd4b5 service nova] Releasing lock "refresh_cache-ec08677b-c923-4307-855e-c6326dfedf6e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lazy-loading 'flavor' on Instance uuid 9866d0ef-d713-4601-b797-780abd5fb7af {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:02 user nova-compute[74880]: INFO nova.compute.manager [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Attaching volume 1ff31693-0e95-473d-ba5e-09a57ba06e92 to /dev/sdc
Nov 15 01:16:02 user nova-compute[74880]: DEBUG os_brick.utils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf654cb9-92cd-49aa-90b8-49c8ebca11df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6312f40-e7dc-432d-90bc-f4d692af241b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4668a40a-28fd-42e6-b49d-658a46e179d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a33817-cde6-498e-8618-f93d2fdc24ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:02 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70760bf-27f4-4a81-9d3b-e16b2ada2b77]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG os_brick.utils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:02 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updating existing volume attachment record: 7c447e05-e52a-4dd7-8561-f2d0428ae781 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:16:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:06 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[17598117-8b8a-474a-aa91-bb87747e6b95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:06 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd79755-bebf-44fc-9fd1-61202aec9868]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0] added
Nov 15 01:16:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f1fa73-f63c-48f2-bd2d-b2e9d70e63e7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[251716b8-0815-4364-81d6-fe49b94f147c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAvowTgp {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAvowTgp" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ceab47-5a1b-4b6a-8df8-dce4577227f0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAvowTgp'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca4b662-4ac8-420b-af66-8640919b67b9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ccf27a-acb3-4ab2-9204-d5929c90e855]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1158da61-5e0c-4f52-883f-de2704a2d563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]
Nov 15 01:16:06 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff53bff-0cc0-4502-bbdf-13a5e359ed16]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[498ffc92-6e43-4b8d-a49e-8ef5767f4517]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:06 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd7b29-ad32-4ead-9f62-7944808fb904]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bayLneIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:07 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26538366530666162', 'path': '/dev/sdh'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538366530666162', 'path': '/dev/sdh'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.737s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:07 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:07 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG nova.objects.instance [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lazy-loading 'flavor' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492e54e-9a82-43b6-8c21-2746885fa5d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:07 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:16:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:07 user nova-compute[74880]:   <source dev="/dev/sdh"/>
Nov 15 01:16:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:07 user nova-compute[74880]:   <serial>b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0</serial>
Nov 15 01:16:07 user nova-compute[74880]: </disk>
Nov 15 01:16:07 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2400c364-30aa-45a2-9f19-8615aca6a4df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92] added
Nov 15 01:16:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[06852959-1526-4ba6-a2bf-6bb956458323]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d628bdc8-9084-4c5b-a432-5a08c9cfb394]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bayLneIk {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bayLneIk" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef3d94-5eef-435f-898a-949d1313543c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bayLneIk'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[398258b2-54ce-41c0-9a6f-f791cb142028]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0cbe8-f72b-4348-8a52-593425996728]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:07 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3659f-2368-4b67-b6b7-851573ff8bb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260]
Nov 15 01:16:08 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b73b1-8628-4f59-aa89-030cc9a156f7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[96446fd4-3600-4677-a7bc-90e3b03e6ff6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:08 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[62444fbc-38bb-428f-92e8-5873f11abad3]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bayLneIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] No VIF found with MAC fa:16:3e:5f:e2:d7, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:16:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd07e13f-a8ba-48db-9b6d-04371f8cfdf2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.088s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] <== connect_volume: return (2106ms) {'type': 'block', 'scsi_wwn': '23263323361306662', 'path': '/dev/sdj'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263323361306662', 'path': '/dev/sdj'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lazy-loading 'flavor' on Instance uuid 9866d0ef-d713-4601-b797-780abd5fb7af {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:16:09 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:09 user nova-compute[74880]:   <source dev="/dev/sdj"/>
Nov 15 01:16:09 user nova-compute[74880]:   <target dev="sdc" bus="scsi"/>
Nov 15 01:16:09 user nova-compute[74880]:   <serial>1ff31693-0e95-473d-ba5e-09a57ba06e92</serial>
Nov 15 01:16:09 user nova-compute[74880]:   <address type="drive" controller="0" unit="2"/>
Nov 15 01:16:09 user nova-compute[74880]: </disk>
Nov 15 01:16:09 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.utils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed5628-6988-4cf1-9415-fd390998dbc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e76d4c2-816c-4fbe-9da9-f691a960eb46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbca573-14ae-4524-b39a-d44e7f6b8cc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2155dd3-7991-4f68-a48d-63700854b4c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:09 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4085631b-6d6f-4351-a997-39126a3a7e12]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG os_brick.utils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:09 user nova-compute[74880]: INFO nova.compute.manager [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Swapping volume b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 for 84759dd6-f021-486c-9203-68e7261158e7
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No BDM found with device name sda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] No VIF found with MAC fa:16:3e:03:38:a5, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:16:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bd496877-01b2-4afe-8512-ffd07746399e tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.779s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-changed-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Refreshing instance network info cache due to event network-changed-8a183bba-7c9d-4f2c-9697-34d8caed5c8a. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] Acquiring lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] Acquired lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.network.neutron [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Refreshing network info cache for port 8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:11 user nova-compute[74880]: INFO nova.compute.manager [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Detaching volume 1ff31693-0e95-473d-ba5e-09a57ba06e92
Nov 15 01:16:11 user nova-compute[74880]: INFO nova.virt.block_device [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Attempting to driver detach volume 1ff31693-0e95-473d-ba5e-09a57ba06e92 from mountpoint /dev/sdc
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Attempting to detach device sdc from instance 9866d0ef-d713-4601-b797-780abd5fb7af from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:11 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:11 user nova-compute[74880]:   <source dev="/dev/sdj"/>
Nov 15 01:16:11 user nova-compute[74880]:   <target dev="sdc" bus="scsi"/>
Nov 15 01:16:11 user nova-compute[74880]:   <serial>1ff31693-0e95-473d-ba5e-09a57ba06e92</serial>
Nov 15 01:16:11 user nova-compute[74880]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 01:16:11 user nova-compute[74880]: </disk>
Nov 15 01:16:11 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Successfully detached device sdc from instance 9866d0ef-d713-4601-b797-780abd5fb7af from the persistent domain config.
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9866d0ef-d713-4601-b797-780abd5fb7af from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:11 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:11 user nova-compute[74880]:   <source dev="/dev/sdj"/>
Nov 15 01:16:11 user nova-compute[74880]:   <target dev="sdc" bus="scsi"/>
Nov 15 01:16:11 user nova-compute[74880]:   <serial>1ff31693-0e95-473d-ba5e-09a57ba06e92</serial>
Nov 15 01:16:11 user nova-compute[74880]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 01:16:11 user nova-compute[74880]: </disk>
Nov 15 01:16:11 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lazy-loading 'flavor' on Instance uuid 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.network.neutron [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updated VIF entry in instance network info cache for port 8a183bba-7c9d-4f2c-9697-34d8caed5c8a. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.network.neutron [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updating instance_info_cache with network_info: [{"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dfbec645-17e9-424e-af16-b953ddcf586d req-0d455868-c63c-4f20-90fb-49885d583785 service nova] Releasing lock "refresh_cache-8dbd7773-a064-47c0-926f-c12afcb24d7f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9866d0ef-d713-4601-b797-780abd5fb7af {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:11 user nova-compute[74880]: INFO nova.compute.manager [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Attaching volume 5d0f4fe7-e73a-4754-a832-b54fe63b8f42 to /dev/vdb
Nov 15 01:16:11 user nova-compute[74880]: DEBUG os_brick.utils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f23679-06cd-4a6a-9889-238a51984de5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b205bd-f35e-4453-b6c0-26d6dbf53dfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b2d52-928d-4bdb-9fc5-c542d59d45d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2de9d1-3d70-4aa9-84b2-d5e0736f70a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:11 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bdf63f-2af3-4753-8bbb-bf21fcbd5aec]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG os_brick.utils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:11 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updating existing volume attachment record: f6d02832-2245-49a3-83bc-87b80cbffcd0 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:16:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwBGuFpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec08677b-c923-4307-855e-c6326dfedf6e', 'attached_at': '', 'detached_at': '', 'volume_id': '84759dd6-f021-486c-9203-68e7261158e7', 'serial': '84759dd6-f021-486c-9203-68e7261158e7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'ec08677b-c923-4307-855e-c6326dfedf6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'serial'} {{(pid=74880) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwBGuFpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:14 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:14 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:14 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9335dfb-8f47-4c35-8ecb-04ef6f1fcf65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:14 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc15248-865e-4a33-8bea-a934e3771658]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7] added
Nov 15 01:16:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2a933-7521-40c9-b40a-3773d6761cae]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e1504-5986-4eb1-a240-c1ac57a48840]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwBGuFpg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwBGuFpg" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c820ea4-30e0-49ca-a4ba-01e4b37c468d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwBGuFpg'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d138be-e0ea-40c8-980d-85414552ca88]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8fe0c8-5fff-4ca5-85af-0f9c0401ad4e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae31ac-1d80-438d-b4ed-2471fe8ad274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260]
Nov 15 01:16:14 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd48c3d1-41d3-4201-9479-08d58541e25f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[630be7f4-7c1f-440e-8aaa-cb4696dda242]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:14 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c226de9-aad8-468f-827c-837d9f7a3071]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:15 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwBGuFpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23463316265376233', 'path': '/dev/sdk'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463316265376233', 'path': '/dev/sdk'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:16 user nova-compute[74880]: DEBUG nova.objects.instance [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lazy-loading 'flavor' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 99614720 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 264241152 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 342884352 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 380633088 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXHVcGlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:18 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:18 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:18 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ef634-115a-42f6-a915-73a1e9fbab35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:18 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd07cbe-ec49-4644-839d-4c70c4d87514]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42] added
Nov 15 01:16:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178518d-72e3-490c-b0cb-c1ccc907342a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5543a7c3-d6c5-4bce-9e40-4d337054e820]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXHVcGlv {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXHVcGlv" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10edbdd-8af3-4261-ae2c-983c969b7668]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CXHVcGlv'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf28f16-80c1-4992-9e42-92821d89eb86]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33064c0a-6e95-4cc5-a07a-90c3e4cf738d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 533725184 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ef1fa4-2774-44e5-a949-bb3d1225e905]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260]
Nov 15 01:16:19 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408539f-5f1a-46ce-ac6d-aa7e52964a98]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f132b99-c922-4a35-91f6-f9a1b03bb10f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:19 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041ec7a-21e5-40a9-9fe6-daa8f4a2ca10]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 677380096 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 849346560 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXHVcGlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] <== connect_volume: return (1531ms) {'type': 'block', 'scsi_wwn': '23036316461366634', 'path': '/dev/sdl'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036316461366634', 'path': '/dev/sdl'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lazy-loading 'flavor' on Instance uuid 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 01:16:20 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:20 user nova-compute[74880]:   <source dev="/dev/sdl"/>
Nov 15 01:16:20 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:20 user nova-compute[74880]:   <serial>5d0f4fe7-e73a-4754-a832-b54fe63b8f42</serial>
Nov 15 01:16:20 user nova-compute[74880]: </disk>
Nov 15 01:16:20 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 1012924416 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] No VIF found with MAC fa:16:3e:70:3c:44, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:16:20 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc155ceb-d7ca-477b-8479-a459fa50af05 is timed out.
Nov 15 01:16:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Successfully detached device vdb from instance bc155ceb-d7ca-477b-8479-a459fa50af05 from the live domain config.
Nov 15 01:16:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItDGbZCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:20 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cbf00c-3dc3-47ee-8698-19231181b24f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:21 user nova-compute[74880]: No targets found.
Nov 15 01:16:21 user nova-compute[74880]: iSNS:
Nov 15 01:16:21 user nova-compute[74880]: No targets found.
Nov 15 01:16:21 user nova-compute[74880]: STATIC:
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:21 user nova-compute[74880]: No targets found.
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:21 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:21 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e617bf0-a4b2-4a4d-89f6-943254948ff5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d6baba-7113-415f-bf1d-3f0a3daea453]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d (non-flash)
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9513dcf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d'): ({'sdi'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Removing single pathed devices sdi {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44808eba-05c7-43cc-9155-0370cbfecbbd tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.419s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfe6e6b-def8-4c59-ae0c-3b3dec4889d4]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[462dd4ff-b5d1-4988-9fe8-4f7831fc5e8b]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Flushing IO for device /dev/sdi {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b51b2-492e-4688-9850-0aeffbf046bc]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeccd5a-50fd-4efd-998e-1ee32d8a3e73]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] SCSI volumes sdi have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[307644ea-41f1-49b4-be59-922b2040d352]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:21 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ac361-8df8-43de-8dd0-a97fb4d2f2f9]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260]
Nov 15 01:16:21 user nova-compute[74880]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9652389d-9196-4091-802f-8de229165e1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ce0c9-5c71-4d27-a99e-b99b021dd20b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] <== disconnect_volume: return (363ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.097s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3f2ea6-d1a4-4340-96fd-8d321526e217]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:21 user nova-compute[74880]: No targets found.
Nov 15 01:16:21 user nova-compute[74880]: iSNS:
Nov 15 01:16:21 user nova-compute[74880]: No targets found.
Nov 15 01:16:21 user nova-compute[74880]: STATIC:
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52
Nov 15 01:16:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:21 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:21 user nova-compute[74880]: No targets found.
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:21 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:21 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ac007f-2635-4c30-bf3d-151e6ec0c77f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab639050-cf21-4a3e-82ca-789ccdacd547]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:21 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f95082ab910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0'): ({'sdh'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Removing single pathed devices sdh {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb0b272-15c7-4dea-b206-a62cbe7bf370]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c01275-e950-456f-85bb-401f5b07082b]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Flushing IO for device /dev/sdh {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d20d43b-06f9-4309-b6d0-48c8bbe99d1e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ed14c-0af8-461a-918c-dc0b2d6092da]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] SCSI volumes sdh have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96240cd-f161-441f-a499-04b40829ea05]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a05b5b6-5eb6-4de8-a3b7-2ef3aaf25317]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]
Nov 15 01:16:21 user nova-compute[74880]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699f5f5-b254-4783-bc1d-adb5d5f75f6d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] <== disconnect_volume: return (451ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwBGuFpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'ec08677b-c923-4307-855e-c6326dfedf6e', 'attached_at': '', 'detached_at': '', 'volume_id': '84759dd6-f021-486c-9203-68e7261158e7', 'serial'} {{(pid=74880) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] swap_volume: removing Cinder connection for volume b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 {{(pid=74880) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] volume_snapshot_create: create_info: {'snapshot_id': '70dab791-8464-4eb0-a3f1-49c7955edc71', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74880) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] snap xml: <domainsnapshot>
Nov 15 01:16:21 user nova-compute[74880]:   <disks>
Nov 15 01:16:21 user nova-compute[74880]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 15 01:16:21 user nova-compute[74880]:       <source file="/dev/new_file"/>
Nov 15 01:16:21 user nova-compute[74880]:     </disk>
Nov 15 01:16:21 user nova-compute[74880]:     <disk name="vda" snapshot="no"/>
Nov 15 01:16:21 user nova-compute[74880]:   </disks>
Nov 15 01:16:21 user nova-compute[74880]: </domainsnapshot>
Nov 15 01:16:21 user nova-compute[74880]:  {{(pid=74880) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] Lazy-loading 'system_metadata' on Instance uuid 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 01:16:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-23e3a1d7-40af-4952-86d9-211d54d07563 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] volume_snapshot_delete: delete_info: {'volume_id': '5d0f4fe7-e73a-4754-a832-b54fe63b8f42'} {{(pid=74880) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [None req-23e3a1d7-40af-4952-86d9-211d54d07563 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Traceback (most recent call last):
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     if delete_info['type'] != 'qcow2':
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] KeyError: 'type'
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] 
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Traceback (most recent call last):
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     rv = execute(f, *args, **kwargs)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     six.reraise(c, e, tb)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     raise value
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     rv = meth(*args, **kwargs)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] 
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Traceback (most recent call last):
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     self._volume_snapshot_create(context, instance, guest,
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     rv = execute(f, *args, **kwargs)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     six.reraise(c, e, tb)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     raise value
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     rv = meth(*args, **kwargs)
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:21 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [None req-23e3a1d7-40af-4952-86d9-211d54d07563 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-842d653a-7540-426c-bc74-0d638ea9de64)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server [None req-23e3a1d7-40af-4952-86d9-211d54d07563 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] Exception during message handling: KeyError: 'type'
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 70dab791-8464-4eb0-a3f1-49c7955edc71 could not be found.
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 70dab791-8464-4eb0-a3f1-49c7955edc71 could not be found. (HTTP 404) (Request-ID: req-38df6019-6689-4fa1-9fdb-12f304c6e771)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 70dab791-8464-4eb0-a3f1-49c7955edc71 could not be found.
Nov 15 01:16:22 user nova-compute[74880]: ERROR nova.virt.libvirt.driver 
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server [None req-3f4f0f11-ca68-4e99-ace4-eddd40c26035 tempest-VolumesAssistedSnapshotsTest-1303809947 tempest-VolumesAssistedSnapshotsTest-1303809947-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 01:16:22 user nova-compute[74880]: ERROR oslo_messaging.rpc.server 
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'flavor' on Instance uuid bc155ceb-d7ca-477b-8479-a459fa50af05 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cf90c4e5-b926-40cd-b5a3-4ebb0424da0f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:22 user nova-compute[74880]: INFO nova.compute.manager [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Detaching volume 5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:22 user nova-compute[74880]: INFO nova.virt.block_device [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Attempting to driver detach volume 5d0f4fe7-e73a-4754-a832-b54fe63b8f42 from mountpoint /dev/vdb
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Attempting to detach device vdb from instance 8dbd7773-a064-47c0-926f-c12afcb24d7f from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:22 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:22 user nova-compute[74880]:   <source dev="/dev/sdl"/>
Nov 15 01:16:22 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:22 user nova-compute[74880]:   <serial>5d0f4fe7-e73a-4754-a832-b54fe63b8f42</serial>
Nov 15 01:16:22 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:16:22 user nova-compute[74880]: </disk>
Nov 15 01:16:22 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:22 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Successfully detached device vdb from instance 8dbd7773-a064-47c0-926f-c12afcb24d7f from the persistent domain config.
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8dbd7773-a064-47c0-926f-c12afcb24d7f from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:22 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:22 user nova-compute[74880]:   <source dev="/dev/sdl"/>
Nov 15 01:16:22 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:22 user nova-compute[74880]:   <serial>5d0f4fe7-e73a-4754-a832-b54fe63b8f42</serial>
Nov 15 01:16:22 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:16:22 user nova-compute[74880]: </disk>
Nov 15 01:16:22 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] swap_volume: Updating volume b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "IwBGuFpg", "auth_password": "MW76w1OzuTq58Q", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "84759dd6-f021-486c-9203-68e7261158e7"}, "status": "reserved", "instance": "ec08677b-c923-4307-855e-c6326dfedf6e", "attached_at": "", "detached_at": "", "volume_id": "84759dd6-f021-486c-9203-68e7261158e7", "serial": "84759dd6-f021-486c-9203-68e7261158e7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '84759dd6-f021-486c-9203-68e7261158e7', 'no_device': None, 'attachment_id': '8582d9e2-a42a-450e-8ed7-6896c53c2632'} {{(pid=74880) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-060dc06c-e478-489b-bb0c-3a39c186f14e tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.565s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG os_brick.utils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[760dd17f-9188-40cd-a952-de2705ec54f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b212a4-ad73-4fbc-9502-b56f72b3a8a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de41cc9-c682-4b51-bdfd-9f46f8a27ff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a1f405-ce6a-4236-8863-34fb0c946700]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:24 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[096dea9e-7ece-409d-9627-e0e8cc47454b]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:24 user nova-compute[74880]: DEBUG os_brick.utils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:24 user nova-compute[74880]: INFO nova.compute.manager [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Swapping volume 84759dd6-f021-486c-9203-68e7261158e7 for b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec08677b-c923-4307-855e-c6326dfedf6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'serial': 'b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwBGuFpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '84759dd6-f021-486c-9203-68e7261158e7'}, 'status': 'reserved', 'instance': 'ec08677b-c923-4307-855e-c6326dfedf6e', 'attached_at': '', 'detached_at': '', 'volume_id': '84759dd6-f021-486c-9203-68e7261158e7', 'serial'} {{(pid=74880) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:29 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:29 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:29 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[06708034-f02f-4760-adf6-dc22f73ef750]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:29 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9229c238-bc39-4943-b37c-6ac894b753ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0] added
Nov 15 01:16:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14dea7e-f90a-4157-9dbc-a785902bbe54]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb8352-80e2-4834-b946-616dbd9fde24]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAvowTgp {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAvowTgp" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da1ddb0-1aa0-4e8e-9922-0fef9bd354d9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAvowTgp'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[461bce7f-b3e9-4cc3-a0ba-203dedbd8709]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c784f3-7a3b-4e9c-b2e7-300108d29a73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[95decbc7-ced0-4666-9046-73d4c9a4bddf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]
Nov 15 01:16:29 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac9fbfd-845a-4572-94ea-c2574d7ac576]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d661f593-1869-4ff7-8c49-606828679c83]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:29 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a4646a-27a2-4693-98b0-452e541a19be]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:30 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:30 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:30 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:30 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26538366530666162', 'path': '/dev/sdh'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538366530666162', 'path': '/dev/sdh'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lazy-loading 'flavor' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 154140672 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:31 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 9866d0ef-d713-4601-b797-780abd5fb7af is timed out.
Nov 15 01:16:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Successfully detached device sdc from instance 9866d0ef-d713-4601-b797-780abd5fb7af from the live domain config.
Nov 15 01:16:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bayLneIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:31 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[50176361-3e42-456c-a0b9-2bc2b2f5c9fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:31 user nova-compute[74880]: No targets found.
Nov 15 01:16:31 user nova-compute[74880]: iSNS:
Nov 15 01:16:31 user nova-compute[74880]: No targets found.
Nov 15 01:16:31 user nova-compute[74880]: STATIC:
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52
Nov 15 01:16:31 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:31 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:31 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:31 user nova-compute[74880]: No targets found.
Nov 15 01:16:31 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:31 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:31 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e28356-0851-4a60-88ef-88ad624dd85c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cfd77c-4f6f-4b2e-b144-b7d4dace935c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:31 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:31 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01bce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92'): ({'sdj'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Removing single pathed devices sdj {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd8dbc6-6416-4975-907d-f89b3601391c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da800de-478d-42fd-aee9-599a2f68a7f5]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Flushing IO for device /dev/sdj {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bcf61f-fe3d-449d-92dc-9b22c9d4036c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.050s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc09235d-fb43-43d5-9435-fdda0ad83519]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] SCSI volumes sdj have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087914f-c595-4e3d-8256-7c5a934ea882]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e853fb-b657-4b01-9c17-166906ff0a26]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260]
Nov 15 01:16:32 user nova-compute[74880]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff31693-0e95-473d-ba5e-09a57ba06e92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a6b6c-cdc4-44a7-9248-4b832a48ae8f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] <== disconnect_volume: return (485ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 455081984 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-changed-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Refreshing instance network info cache due to event network-changed-79379e5f-03d1-42b8-aff4-71297ee3f026. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] Acquiring lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] Acquired lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Refreshing network info cache for port 79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 580911104 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.objects.instance [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lazy-loading 'flavor' on Instance uuid 9866d0ef-d713-4601-b797-780abd5fb7af {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5907d892-f01d-4439-9016-0cffe745a397 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.271s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 700448768 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updated VIF entry in instance network info cache for port 79379e5f-03d1-42b8-aff4-71297ee3f026. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:16:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updating instance_info_cache with network_info: [{"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c62d36dd-1a99-438b-a470-6e85327c164d req-a0961ff8-9dce-4864-95eb-e9ab1c4cadc7 service nova] Releasing lock "refresh_cache-026890b4-5a76-4730-bc20-54b95359bdcc" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 741343232 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.objects.instance [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'flavor' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-changed-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing instance network info cache due to event network-changed-65bd5242-7df3-407c-b280-752f322cd1e8. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] Acquiring lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] Acquired lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Refreshing network info cache for port 65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:34 user nova-compute[74880]: INFO nova.compute.manager [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attaching volume b85f66b3-5491-4dad-917b-d00b210f6a57 to /dev/vdb
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:34 user nova-compute[74880]: INFO nova.compute.manager [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Terminating instance
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG os_brick.utils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1d10a0-7b0d-4e7a-8f3f-b287253347bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 909115392 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4269595e-5841-4e69-836d-9e8d244f0919]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.042s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8566b4da-6564-4650-abe7-4468517e2af2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff18ceab-c5bd-45f7-bb8e-62375bddfea1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:34 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[546103e7-b1b4-416a-8958-458478c04d0d]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG os_brick.utils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] <== get_connector_properties: return (249ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updating existing volume attachment record: c43a9ffe-1094-4ff2-afa6-7ccec8bf534b {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:16:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-87182253-785d-4fdc-bbb1-a94336266ac0 req-21c67fac-64dd-4613-aae6-bc5ff16e90ce service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-vif-unplugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87182253-785d-4fdc-bbb1-a94336266ac0 req-21c67fac-64dd-4613-aae6-bc5ff16e90ce service nova] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87182253-785d-4fdc-bbb1-a94336266ac0 req-21c67fac-64dd-4613-aae6-bc5ff16e90ce service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87182253-785d-4fdc-bbb1-a94336266ac0 req-21c67fac-64dd-4613-aae6-bc5ff16e90ce service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-87182253-785d-4fdc-bbb1-a94336266ac0 req-21c67fac-64dd-4613-aae6-bc5ff16e90ce service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] No waiting events found dispatching network-vif-unplugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-87182253-785d-4fdc-bbb1-a94336266ac0 req-21c67fac-64dd-4613-aae6-bc5ff16e90ce service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-vif-unplugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 1070596096 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Instance destroyed successfully.
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.objects.instance [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lazy-loading 'resources' on Instance uuid 9866d0ef-d713-4601-b797-780abd5fb7af {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-10637562',display_name='tempest-AttachSCSIVolumeTestJSON-server-10637562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-10637562',id=7,image_ref='efbec64d-a83f-48c0-844e-e2740d5bbc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxKaPFs2y3FnNmqS8+sI0/Kt/K1Jkr4mNXqcNwnwyz8ktonFQ/nXyot/Zx0F3ZVJgLY7AWJBYjlB9YvYgajB1zM2311dlh9JJRiSNS90EJRZNckkNUIoFZiVINg692qhA==',key_name='tempest-keypair-58174793',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f61ca3118144cba2be2c366b933e2d',ramdisk_id='',reservation_id='r-byhjnczx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efbec64d-a83f-48c0-844e-e2740d5bbc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1714219061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1714219061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='226080944cc547b089ec5ee30e804e10',uuid=9866d0ef-d713-4601-b797-780abd5fb7af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Converting VIF {"id": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "address": "fa:16:3e:03:38:a5", "network": {"id": "71f315fe-9336-4cc2-a6ce-df2dfb8bb26f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-251006848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f61ca3118144cba2be2c366b933e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef030-7b", "ovs_interfaceid": "d9bef030-7b06-4058-ab38-ae84ea0f34d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_vif [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9bef030-7b, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4356beb5-9d4f-4e6d-bd9d-99f6e64f039d) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:35 user nova-compute[74880]: INFO os_vif [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:38:a5,bridge_name='br-int',has_traffic_filtering=True,id=d9bef030-7b06-4058-ab38-ae84ea0f34d1,network=Network(71f315fe-9336-4cc2-a6ce-df2dfb8bb26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef030-7b')
Nov 15 01:16:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Deleting instance files /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af_del
Nov 15 01:16:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Deletion of /opt/stack/data/nova/instances/9866d0ef-d713-4601-b797-780abd5fb7af_del complete
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updated VIF entry in instance network info cache for port 65bd5242-7df3-407c-b280-752f322cd1e8. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-38aa8d84-7974-4ba6-a87b-17c90efe8e5a req-d55e85c5-6d08-4fa7-84c9-4126278ac508 service nova] Releasing lock "refresh_cache-dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:35 user nova-compute[74880]: INFO nova.compute.manager [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwBGuFpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '84759dd6-f021-486c-9203-68e7261158e7'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:35 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66abf8f-0982-427a-9a7d-bf669835ab06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:35 user nova-compute[74880]: No targets found.
Nov 15 01:16:35 user nova-compute[74880]: iSNS:
Nov 15 01:16:35 user nova-compute[74880]: No targets found.
Nov 15 01:16:35 user nova-compute[74880]: STATIC:
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52
Nov 15 01:16:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:35 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:35 user nova-compute[74880]: No targets found.
Nov 15 01:16:35 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:35 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:35 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[17570273-372e-454b-aa01-9b0fd30c53b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f22e79b-5457-4fd7-a076-f5ef8832a206]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:36 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01b7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7'): ({'sdk'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Removing single pathed devices sdk {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d9caa-0dc8-480f-97c8-69478aa0cc76]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37513d59-15b9-4425-b662-c99de14226a8]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Flushing IO for device /dev/sdk {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e7a868-5a9f-4679-9d2b-95b8fded1dc9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e9ccf-5e05-4171-bf0d-9cb41988efbe]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] SCSI volumes sdk have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ece9b31-758c-4492-86d8-e16a19a580c3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac9b05-4128-4636-864d-8b0ccf133778]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260]
Nov 15 01:16:36 user nova-compute[74880]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84759dd6-f021-486c-9203-68e7261158e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe032434-113c-4c26-a53f-73966ce13501]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] <== disconnect_volume: return (361ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'ec08677b-c923-4307-855e-c6326dfedf6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'serial'} {{(pid=74880) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] swap_volume: removing Cinder connection for volume 84759dd6-f021-486c-9203-68e7261158e7 {{(pid=74880) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-changed-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing instance network info cache due to event network-changed-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] Acquiring lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] Acquired lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.network.neutron [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Refreshing network info cache for port ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:16:36 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:37 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Took 1.38 seconds to deallocate network for instance.
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updated VIF entry in instance network info cache for port ce77ed63-bd1b-4c4d-8c7f-80f142cad54b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-38a2db3f-9d77-4fdf-a614-03041d76b12a req-a2632b25-8980-4785-a4e9-552c1d21cdfa service nova] Releasing lock "refresh_cache-23781762-45a9-4943-b18e-19f6b8784e32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] swap_volume: Updating volume 84759dd6-f021-486c-9203-68e7261158e7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "sAvowTgp", "auth_password": "VqHK0fdn8BY1eh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0"}, "status": "reserved", "instance": "ec08677b-c923-4307-855e-c6326dfedf6e", "attached_at": "", "detached_at": "", "volume_id": "b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0", "serial": "b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'no_device': None, 'attachment_id': 'd053c698-a192-4b6e-9479-bd0db0323af7'} {{(pid=74880) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d80f00f3-acd0-4eac-b8d4-ff99498e4bb5 tempest-TestVolumeSwap-351353558 tempest-TestVolumeSwap-351353558-project-admin] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.152s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] Acquiring lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] Lock "9866d0ef-d713-4601-b797-780abd5fb7af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] No waiting events found dispatching network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:37 user nova-compute[74880]: WARNING nova.compute.manager [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received unexpected event network-vif-plugged-d9bef030-7b06-4058-ab38-ae84ea0f34d1 for instance with vm_state deleted and task_state None.
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-51d45a54-6ae6-47ff-98ba-a7691656ae05 req-b265c027-b34a-4a8a-9daa-4c4944424000 service nova] [instance: 9866d0ef-d713-4601-b797-780abd5fb7af] Received event network-vif-deleted-d9bef030-7b06-4058-ab38-ae84ea0f34d1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:37 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Deleted allocations for instance 9866d0ef-d713-4601-b797-780abd5fb7af
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-70f15012-0fbc-4045-bc03-7f8d31a911f7 tempest-AttachSCSIVolumeTestJSON-1714219061 tempest-AttachSCSIVolumeTestJSON-1714219061-project-member] Lock "9866d0ef-d713-4601-b797-780abd5fb7af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:37 user nova-compute[74880]: INFO nova.compute.manager [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Terminating instance
Nov 15 01:16:37 user nova-compute[74880]: DEBUG nova.compute.manager [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-73930b3a-8f06-4826-a588-229051fa1bb3 req-2ffbf876-0a33-4916-8932-328ce576515b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-73930b3a-8f06-4826-a588-229051fa1bb3 req-2ffbf876-0a33-4916-8932-328ce576515b service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-73930b3a-8f06-4826-a588-229051fa1bb3 req-2ffbf876-0a33-4916-8932-328ce576515b service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-73930b3a-8f06-4826-a588-229051fa1bb3 req-2ffbf876-0a33-4916-8932-328ce576515b service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-73930b3a-8f06-4826-a588-229051fa1bb3 req-2ffbf876-0a33-4916-8932-328ce576515b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-73930b3a-8f06-4826-a588-229051fa1bb3 req-2ffbf876-0a33-4916-8932-328ce576515b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-f4533027-a664-41c8-8206-71edcee4601b for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:38 user nova-compute[74880]: INFO nova.compute.manager [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Detaching volume b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-2efc98a8-4654-4b7a-82e0-dce698b79fa5 req-b439a911-0b54-47e1-a006-21508edcc8fa service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2efc98a8-4654-4b7a-82e0-dce698b79fa5 req-b439a911-0b54-47e1-a006-21508edcc8fa service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2efc98a8-4654-4b7a-82e0-dce698b79fa5 req-b439a911-0b54-47e1-a006-21508edcc8fa service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2efc98a8-4654-4b7a-82e0-dce698b79fa5 req-b439a911-0b54-47e1-a006-21508edcc8fa service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-2efc98a8-4654-4b7a-82e0-dce698b79fa5 req-b439a911-0b54-47e1-a006-21508edcc8fa service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-2efc98a8-4654-4b7a-82e0-dce698b79fa5 req-b439a911-0b54-47e1-a006-21508edcc8fa service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: INFO nova.virt.block_device [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Attempting to driver detach volume b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 from mountpoint /dev/vdb
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Attempting to detach device vdb from instance ec08677b-c923-4307-855e-c6326dfedf6e from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:38 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:38 user nova-compute[74880]:   <source dev="/dev/sdh"/>
Nov 15 01:16:38 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:38 user nova-compute[74880]:   <serial>b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0</serial>
Nov 15 01:16:38 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:16:38 user nova-compute[74880]: </disk>
Nov 15 01:16:38 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Successfully detached device vdb from instance ec08677b-c923-4307-855e-c6326dfedf6e from the persistent domain config.
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec08677b-c923-4307-855e-c6326dfedf6e from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:38 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:38 user nova-compute[74880]:   <source dev="/dev/sdh"/>
Nov 15 01:16:38 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:38 user nova-compute[74880]:   <serial>b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0</serial>
Nov 15 01:16:38 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:16:38 user nova-compute[74880]: </disk>
Nov 15 01:16:38 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-65bd5242-7df3-407c-b280-752f322cd1e8 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:39 user nova-compute[74880]: WARNING nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-65bd5242-7df3-407c-b280-752f322cd1e8 for instance with vm_state active and task_state deleting.
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:39 user nova-compute[74880]: WARNING nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-a1345ad0-2bcd-4bdb-bcac-645d7b498f81 for instance with vm_state active and task_state deleting.
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc934f39-9784-4035-b4e0-5c4cea579468 req-0b74f49e-78bd-4c5a-b4e2-ad165d617e47 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "23781762-45a9-4943-b18e-19f6b8784e32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.006s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:39 user nova-compute[74880]: INFO nova.compute.manager [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Terminating instance
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Instance destroyed successfully.
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.objects.instance [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lazy-loading 'resources' on Instance uuid dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65bd5242-7d, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fdc6668-5fb0-42c7-804a-0c79604d1f98) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:32:4b,bridge_name='br-int',has_traffic_filtering=True,id=65bd5242-7df3-407c-b280-752f322cd1e8,network=Network(404c6e76-d414-46ac-8d67-e28a542474b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bd5242-7d')
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1345ad0-2b, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b1c3b62-5f28-40bc-a45f-e05e5e4bd9fa) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-f4533027-a664-41c8-8206-71edcee4601b for instance with vm_state active and task_state deleting.
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-8f45863a-e5c2-4e68-8148-0fc88358f378 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-8f45863a-e5c2-4e68-8148-0fc88358f378 for instance with vm_state active and task_state deleting.
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-74d49850-3949-46d5-b8ed-219b652515a7 req-d1abb8dd-e7f9-411c-a577-8c3aad9a9c7f service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwakyhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:40 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-37702930-fabc-4f04-b5c5-5bc31ea04af3 for instance with vm_state active and task_state deleting.
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 for instance with vm_state active and task_state deleting.
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-unplugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-unplugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 for instance with vm_state active and task_state deleting.
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: WARNING nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b for instance with vm_state active and task_state deleting.
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1019a17-423d-4445-9522-fe50febb46d6 req-0cc018ad-46f0-4037-85ce-b33923e1d36c service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-a3e38161-fe09-4747-af12-b673abc3b159 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb36a6e-a080-486c-bb14-4aa233d017f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:40 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:40 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:ea,bridge_name='br-int',has_traffic_filtering=True,id=a1345ad0-2bcd-4bdb-bcac-645d7b498f81,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1345ad0-2b')
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3bbc7b6-fa, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a53e284-b25f-4a8f-a6a0-613b88d41d18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57] added
Nov 15 01:16:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.050s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e5c55b-04bf-44bb-9a4e-9f0af3a5c1ec]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d68ba9-5c61-4c5d-83ac-0e7c72c0fb24]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiwakyhc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiwakyhc" returned: 0 in 0.034s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[35422725-a2f8-4abc-b772-035c96cdf9de]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiwakyhc'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4377e40-e9ea-4474-9b00-f411508e5850]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d38776-dbd6-4f59-bae1-dfc794346494]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Instance destroyed successfully.
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lazy-loading 'resources' on Instance uuid 23781762-45a9-4943-b18e-19f6b8784e32 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd022072-41ab-4fc9-8b55-749fa00bd476) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e95dd3-695c-4729-8229-b56ee1b9a64c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260]
Nov 15 01:16:41 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f4089-6c89-49ef-85b2-091f4001bb99]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd24fe-478f-4621-abbb-d4a30ef31f54]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:41 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce77ed63-bd, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:41 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:47:48,bridge_name='br-int',has_traffic_filtering=True,id=f3bbc7b6-fa80-4857-a289-8690cd7bafdc,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3bbc7b6-fa')
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "f4533027-a664-41c8-8206-71edcee4601b", "address": "fa:16:3e:24:7b:f7", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4533027-a6", "ovs_interfaceid": "f4533027-a664-41c8-8206-71edcee4601b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1409ac9-5b71-485a-8f82-70732f9547b0]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4533027-a6, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Acquiring lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] No waiting events found dispatching network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:41 user nova-compute[74880]: WARNING nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received unexpected event network-vif-plugged-f3bbc7b6-fa80-4857-a289-8690cd7bafdc for instance with vm_state active and task_state deleting.
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-dbb433bd-a744-47b9-96d6-13d96cd28aab for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:41 user nova-compute[74880]: WARNING nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-dbb433bd-a744-47b9-96d6-13d96cd28aab for instance with vm_state active and task_state deleting.
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-51ae329b-195b-49ca-b783-2a16649b2776 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:41 user nova-compute[74880]: WARNING nova.compute.manager [req-e5ba031e-3f23-4d30-8f26-c32f2a51b046 req-edb8abe2-8671-46d5-a813-1894763e526b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-51ae329b-195b-49ca-b783-2a16649b2776 for instance with vm_state active and task_state deleting.
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d834168-5d7a-414a-9ef4-342fd2be0667) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b537827-44c5-40d0-a88f-79948f48ca3f) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:82:44,bridge_name='br-int',has_traffic_filtering=True,id=ce77ed63-bd1b-4c4d-8c7f-80f142cad54b,network=Network(a29d2025-fe80-4da8-b23d-13466e4be6c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77ed63-bd')
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb433bd-a7, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7b:f7,bridge_name='br-int',has_traffic_filtering=True,id=f4533027-a664-41c8-8206-71edcee4601b,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4533027-a6')
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37702930-fa, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48ba0022-3659-489c-9e3f-472eb38724a2) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=daaa0e8d-f3ae-42ac-ba6e-3ca55e6afb96) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:0d,bridge_name='br-int',has_traffic_filtering=True,id=dbb433bd-a744-47b9-96d6-13d96cd28aab,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdbb433bd-a7')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f45863a-e5, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e3:fd,bridge_name='br-int',has_traffic_filtering=True,id=37702930-fabc-4f04-b5c5-5bc31ea04af3,network=Network(20c1c343-a206-4a4d-93f0-1c8c8beb240b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37702930-fa')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80fb2ead-2b, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c8236f8-0109-4213-a15d-862d828377a3) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cfd5bbb-617b-46c0-8e55-8bfbf9b67af8) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:e6,bridge_name='br-int',has_traffic_filtering=True,id=8f45863a-e5c2-4e68-8148-0fc88358f378,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f45863a-e5')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwakyhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '26637613238336261', 'path': '/dev/sdi'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613238336261', 'path': '/dev/sdi'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.objects.instance [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'flavor' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ae329b-19, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:a7,bridge_name='br-int',has_traffic_filtering=True,id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb2ead-2b')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-135110245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-135110245',id=11,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP+UcNBwxOrR9HOWjd8fByn5xMGpYpaM+DvCQil/Y8je6LK0R9iZGT16nJk0cJ6fqSSox+b34kwps6Kj58bAWFpXJh2BDRMCRzh+vmDDYsU3JqXsYQeais6nitROv2AXA==',key_name='tempest-keypair-1237433938',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3afd6b79ca734255a07a8a9273706ca4',ramdisk_id='',reservation_id='r-tuqxzxp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-5491643',owner_user_name='tempest-TaggedBootDevicesTest_v242-5491643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f104b53490e44b2f9ab950b9d382909c',uuid=dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converting VIF {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:16:42 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:42 user nova-compute[74880]:   <source dev="/dev/sdi"/>
Nov 15 01:16:42 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:16:42 user nova-compute[74880]:   <serial>b85f66b3-5491-4dad-917b-d00b210f6a57</serial>
Nov 15 01:16:42 user nova-compute[74880]: </disk>
Nov 15 01:16:42 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap680b6bd7-ed, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9207f392-ff06-4326-a560-d51263e8c54e) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=517f1b98-7158-40b8-91de-fd78ca02ec23) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=51ae329b-195b-49ca-b783-2a16649b2776,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ae329b-19')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2991e3ac-75, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ce:e9,bridge_name='br-int',has_traffic_filtering=True,id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894,network=Network(40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap680b6bd7-ed')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNTPuKtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf620875-9f51-4a2a-a0aa-3bc96e508da6) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab2c8ac-8d0c-43da-801c-e0cd5fd3cf5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:42 user nova-compute[74880]: No targets found.
Nov 15 01:16:42 user nova-compute[74880]: iSNS:
Nov 15 01:16:42 user nova-compute[74880]: No targets found.
Nov 15 01:16:42 user nova-compute[74880]: STATIC:
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:42 user nova-compute[74880]: No targets found.
Nov 15 01:16:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:42 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:42 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:89,bridge_name='br-int',has_traffic_filtering=True,id=2991e3ac-7594-43bd-aa53-f63a10d89df2,network=Network(0f360dc6-93e8-4a01-97a7-1a69b8bc030b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2991e3ac-75')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "b346fb6d-f804-4286-9f11-4796d62b50d5", "address": "fa:16:3e:27:61:71", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb346fb6d-f8", "ovs_interfaceid": "b346fb6d-f804-4286-9f11-4796d62b50d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb346fb6d-f8, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3b0d2-f702-4464-bdce-c5ee416cfa86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b7bf44-83f6-4993-b09b-b53d804d2467) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:61:71,bridge_name='br-int',has_traffic_filtering=True,id=b346fb6d-f804-4286-9f11-4796d62b50d5,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb346fb6d-f8')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961652747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961652747',id=12,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM05upo6bs5I/NmTmXOPQhAMuQEF5TLorN2CGxZjzv/W+8m2InRygxeXCroEGw2M8L3DpHcwAwnX7tSOk0zhIK3BicooO2K2/Xd9GT55Ab3wJRQcC2CrKULDprPczMCDjQ==',key_name='tempest-keypair-910043403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0439938f3f1c4f349e26159daa0d3e5e',ramdisk_id='',reservation_id='r-9vvqbxi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-211578276',owner_user_name='tempest-TaggedBootDevicesTest-211578276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59df6ca8a4b548ada0802c33cf9d6b11',uuid=23781762-45a9-4943-b18e-19f6b8784e32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converting VIF {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3e38161-fe, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95171d7-1416-4196-90dc-1da7c28dbc00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:42 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01b6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d14cbbc5-c623-49dc-974f-73cffbc40946) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:42 user nova-compute[74880]: INFO os_vif [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:75:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e38161-fe09-4747-af12-b673abc3b159,network=Network(b85db234-51a6-4a13-ba86-9d39449adc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e38161-fe')
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSJVsrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[be424537-1d8f-4b5c-acac-fd1eafa5e93b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c91c1e-55fd-4012-807f-7750b530432a]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[330bb108-91f7-4df6-9eb6-5a5ac8be53c9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9679c8a9-ec65-4e5e-bf3e-5bd8358452db]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e7304b-8b27-4734-a788-c2b866bf4691]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No VIF found with MAC fa:16:3e:c5:a0:82, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-2991e3ac-7594-43bd-aa53-f63a10d89df2 for instance with vm_state active and task_state deleting.
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-unplugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-unplugged-b346fb6d-f804-4286-9f11-4796d62b50d5 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING nova.compute.manager [req-a576e3e8-a2b4-4fb4-8f6f-8b65decf84d3 req-3e7e99b2-b6f9-4fa9-9b3e-bd8424633378 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-b346fb6d-f804-4286-9f11-4796d62b50d5 for instance with vm_state active and task_state deleting.
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c986fbe4-35c1-48ef-9abf-39a0a3529992]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260]
Nov 15 01:16:42 user nova-compute[74880]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef1b8c0-4552-4f4f-85dc-4e8d1ffb7a52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb756e-4506-4a68-86fe-bde9e6f9c43b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== disconnect_volume: return (362ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.259s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXsgQeOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-d87ca33b-afd7-446e-9ae4-d5f13c8e447d req-2ad9dd7f-a885-484a-85b0-9c8fcab0149d service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d87ca33b-afd7-446e-9ae4-d5f13c8e447d req-2ad9dd7f-a885-484a-85b0-9c8fcab0149d service nova] Acquiring lock "23781762-45a9-4943-b18e-19f6b8784e32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d87ca33b-afd7-446e-9ae4-d5f13c8e447d req-2ad9dd7f-a885-484a-85b0-9c8fcab0149d service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d87ca33b-afd7-446e-9ae4-d5f13c8e447d req-2ad9dd7f-a885-484a-85b0-9c8fcab0149d service nova] Lock "23781762-45a9-4943-b18e-19f6b8784e32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-d87ca33b-afd7-446e-9ae4-d5f13c8e447d req-2ad9dd7f-a885-484a-85b0-9c8fcab0149d service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] No waiting events found dispatching network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING nova.compute.manager [req-d87ca33b-afd7-446e-9ae4-d5f13c8e447d req-2ad9dd7f-a885-484a-85b0-9c8fcab0149d service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received unexpected event network-vif-plugged-a3e38161-fe09-4747-af12-b673abc3b159 for instance with vm_state active and task_state deleting.
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85ca762-5d10-43d2-8b1c-b077486534a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:42 user nova-compute[74880]: No targets found.
Nov 15 01:16:42 user nova-compute[74880]: iSNS:
Nov 15 01:16:42 user nova-compute[74880]: No targets found.
Nov 15 01:16:42 user nova-compute[74880]: STATIC:
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:42 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:42 user nova-compute[74880]: No targets found.
Nov 15 01:16:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:42 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:42 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8dbd7773-a064-47c0-926f-c12afcb24d7f is timed out.
Nov 15 01:16:42 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Successfully detached device vdb from instance 8dbd7773-a064-47c0-926f-c12afcb24d7f from the live domain config.
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1ccff1df-6d51-4665-acf2-edb833d3083b tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.393s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[518aeb0f-2cc5-484d-a0f8-6d8346244d62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXHVcGlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0512be-12fb-4f9f-a1ca-09e4e49ef961]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01b4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bc7bbb-c458-4723-98d9-a46ddd0ade90]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf0bc85-0846-4f61-81ee-7181c3b5f782]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c62f5-9cb1-444f-a45c-148c03d4dc8d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[01912df4-9145-40dc-b923-fabf7d12b971]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9576d2a3-e87a-467d-bb31-bbb9e13b9c64]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5738162-f53a-412d-b3c9-318f61494350]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260]
Nov 15 01:16:43 user nova-compute[74880]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23be2835-cba7-444f-8f02-60d73e3f0f51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4a3e7-257a-4b85-a37c-87d4ed6770b5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== disconnect_volume: return (597ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.335s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOmuTwsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:43 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f8644-6164-4a41-a6fa-ef1c9a20796e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:43 user nova-compute[74880]: No targets found.
Nov 15 01:16:43 user nova-compute[74880]: iSNS:
Nov 15 01:16:43 user nova-compute[74880]: No targets found.
Nov 15 01:16:43 user nova-compute[74880]: STATIC:
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:43 user nova-compute[74880]: No targets found.
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:43 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:43 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f9921e-0f91-4734-b5ee-9c4288152a1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e816401f-2059-410d-bffb-68f83042d0d4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01bcee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.100s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8a6902-97ac-4077-a8af-37f057c4cc91]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b1e41-bdd1-4383-a548-9ae60b3a2675]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab603913-19df-49a3-b315-19b8c3b839a4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0e40da-684a-4f5d-a80c-80b8fe214443]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25cf1a-c412-42a7-878e-35c9581c9523]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab12c19d-37b8-430a-8089-1b5e731e1ae7]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260]
Nov 15 01:16:43 user nova-compute[74880]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b36c2b-8af5-40a0-9f16-bde131eda69d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cca8f9-bf9d-47e4-9dde-3187b93761ca]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.476s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== disconnect_volume: return (810ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.756s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFVtDUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:43 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7237a-7134-479c-bc1d-0d42701268ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:43 user nova-compute[74880]: No targets found.
Nov 15 01:16:43 user nova-compute[74880]: iSNS:
Nov 15 01:16:43 user nova-compute[74880]: No targets found.
Nov 15 01:16:43 user nova-compute[74880]: STATIC:
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:43 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:43 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:43 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:43 user nova-compute[74880]: No targets found.
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:43 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:43 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2d8b1b-8d72-4b76-9ba4-7b14b0536258]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1428a1-d9ea-4b77-87a2-49acb8a0598a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:43 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:43 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01bcee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42'): ({'sdl'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Removing single pathed devices sdl {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ed97b-a664-42ff-9123-220de9b85c44]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9e5e06-eafb-4510-9cb7-e918253bb1ef]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Flushing IO for device /dev/sdl {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.011s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ffc2a4-ed5d-4333-8799-1bc3fcbedab1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.037s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e468f-1bcd-4bff-851f-3aa55783ca4c]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] SCSI volumes sdl have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec337d-3f8d-4651-9c00-8ef745b206bd]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43861b42-cee9-402d-a254-992c7c239590]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260]
Nov 15 01:16:44 user nova-compute[74880]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4fe7-e73a-4754-a832-b54fe63b8f42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1015ad-c83b-404f-90f2-1026c54ff603]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] <== disconnect_volume: return (1058ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.782s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1939b186-4b75-4f80-9461-dc3e43215eb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]: iSNS:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]: STATIC:
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:44 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:44 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f072e1-1778-48c7-a12b-575145a3c012]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65e403-d886-49a0-bd80-3d54a101a8e0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f951388fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1'): ({'sde'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Removing single pathed devices sde {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8e6584-c7c9-4eb8-be56-3f011b29d5fe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[845122c3-38f1-47fe-97b3-551e2106d1a5]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Flushing IO for device /dev/sde {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e2d7ea-ffb1-4006-a39e-f5bca46c7a06]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b676ea7d-1d1b-4a70-9150-1343edb16f69]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[be574940-bdc3-40f8-b09c-d90d920a9d75]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f021ff-29c1-466d-8c80-e2d9e3406fb1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260]
Nov 15 01:16:44 user nova-compute[74880]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a49ba88-9eb9-4158-8247-996de5791ae1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[566a7109-aeea-4714-b80a-fbc890bdc0ae]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== disconnect_volume: return (1107ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.630s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTbsexLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dac5e3-8787-4a28-bcc7-59a83f305234]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]: iSNS:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]: STATIC:
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:44 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:44 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37a831b-48cc-4f79-b2ba-f2afe1675cac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef092d9-61b0-44cc-a029-822e740f4184]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f951388fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a0ae3-2691-4195-a52f-e0adb6dac91b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c1ca6b-af1b-4686-99ef-dcfc5186591f]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a7c60-672c-4cd0-a1e7-ec68b729f1f5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf105960-b942-4e80-93f0-6335f8fa6fc1]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6899e-0f6d-4140-9e63-5b2845fb1068]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[35760076-2902-4746-9a13-c4b38c184ae9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260]
Nov 15 01:16:44 user nova-compute[74880]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78debe92-ae27-48c9-be7c-9525e8548e9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fe8cd1-53de-4774-ac12-dae6f3d969ce]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] <== disconnect_volume: return (942ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Deleting instance files /opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9_del
Nov 15 01:16:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Deletion of /opt/stack/data/nova/instances/dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9_del complete
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.316s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40564a9f-ed95-4f79-9866-b907fe457501]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]: iSNS:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]: STATIC:
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8
Nov 15 01:16:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:44 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:44 user nova-compute[74880]: No targets found.
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:44 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:44 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4f8152-fa39-45a6-88d3-27708599b256]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: INFO nova.compute.manager [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Took 6.90 seconds to destroy the instance on the hypervisor.
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2597bc-a286-4f0b-b9b8-ff7dc57a935e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 (non-flash)
Nov 15 01:16:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01bc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8'): ({'sdg'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Removing single pathed devices sdg {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lazy-loading 'flavor' on Instance uuid 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[304cf66e-12fd-4734-83b8-3379245c71a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39559d5-e7e4-468d-a964-e659f1fa5a80]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Flushing IO for device /dev/sdg {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-da7c3b06-d01f-4060-8483-ba5b90186831 tempest-VolumesAssistedSnapshotsTest-1855054304 tempest-VolumesAssistedSnapshotsTest-1855054304-project-admin] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.514s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae004e-521d-4aa3-b76c-bae4cad0e92d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd6a63-20f6-48c0-bf8e-3e1542d18eb5]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] SCSI volumes sdg have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22953b-24d4-4224-8020-5777c00d9199]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d5898-762b-4633-a498-b37c08548d68]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260]
Nov 15 01:16:45 user nova-compute[74880]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01445dba-22e1-47d2-837c-6bb3165c6fb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92974035-38e7-4902-b914-f48d144667c4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] <== disconnect_volume: return (666ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:16:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Deleting instance files /opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32_del
Nov 15 01:16:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Deletion of /opt/stack/data/nova/instances/23781762-45a9-4943-b18e-19f6b8784e32_del complete
Nov 15 01:16:45 user nova-compute[74880]: INFO nova.compute.manager [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Took 5.64 seconds to destroy the instance on the hypervisor.
Nov 15 01:16:45 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:16:45 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG nova.objects.instance [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'flavor' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:46 user nova-compute[74880]: INFO nova.compute.manager [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attaching volume 8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 to /dev/vdc
Nov 15 01:16:46 user nova-compute[74880]: DEBUG os_brick.utils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c799f6-7892-4d91-b9d3-2af242a2bebe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[602cc249-7a86-47b8-abde-84c9e7faf8fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf728fbd-408c-4eab-8ed5-31622481de86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ececd2-5ef6-47fb-825a-8647468a1c1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:16:46 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:16:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd1080-fce7-480f-8682-0c76361063e6]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG os_brick.utils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:46 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updating existing volume attachment record: 10523978-3da2-4e43-a5ab-e9f5558970fa {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:16:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-a868377d-9d44-4474-8e7b-f0bcf58ec774 req-f2fac71e-db75-43fd-9061-0cd7399ac052 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-deleted-f4533027-a664-41c8-8206-71edcee4601b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:47 user nova-compute[74880]: INFO nova.compute.manager [req-a868377d-9d44-4474-8e7b-f0bcf58ec774 req-f2fac71e-db75-43fd-9061-0cd7399ac052 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Neutron deleted interface f4533027-a664-41c8-8206-71edcee4601b; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-a868377d-9d44-4474-8e7b-f0bcf58ec774 req-f2fac71e-db75-43fd-9061-0cd7399ac052 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "address": "fa:16:3e:5c:e3:fd", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37702930-fa", "ovs_interfaceid": "37702930-fabc-4f04-b5c5-5bc31ea04af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-a868377d-9d44-4474-8e7b-f0bcf58ec774 req-f2fac71e-db75-43fd-9061-0cd7399ac052 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Detach interface failed, port_id=f4533027-a664-41c8-8206-71edcee4601b, reason: Instance dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-deleted-b346fb6d-f804-4286-9f11-4796d62b50d5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:49 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Neutron deleted interface b346fb6d-f804-4286-9f11-4796d62b50d5; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51ae329b-195b-49ca-b783-2a16649b2776", "address": "fa:16:3e:c8:7d:28", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ae329b-19", "ovs_interfaceid": "51ae329b-195b-49ca-b783-2a16649b2776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Updating instance_info_cache with network_info: [{"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-2727cc6a-7997-41e6-aaa1-39bce8afdee1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Detach interface failed, port_id=b346fb6d-f804-4286-9f11-4796d62b50d5, reason: Instance 23781762-45a9-4943-b18e-19f6b8784e32 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-deleted-37702930-fabc-4f04-b5c5-5bc31ea04af3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:49 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Neutron deleted interface 37702930-fabc-4f04-b5c5-5bc31ea04af3; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "address": "fa:16:3e:55:4c:a7", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb2ead-2b", "ovs_interfaceid": "80fb2ead-2bbb-41d3-a6ce-efb4e0885c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Detach interface failed, port_id=37702930-fabc-4f04-b5c5-5bc31ea04af3, reason: Instance dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-deleted-51ae329b-195b-49ca-b783-2a16649b2776 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:49 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Neutron deleted interface 51ae329b-195b-49ca-b783-2a16649b2776; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "address": "fa:16:3e:25:67:89", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2991e3ac-75", "ovs_interfaceid": "2991e3ac-7594-43bd-aa53-f63a10d89df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Detach interface failed, port_id=51ae329b-195b-49ca-b783-2a16649b2776, reason: Instance 23781762-45a9-4943-b18e-19f6b8784e32 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-deleted-80fb2ead-2bbb-41d3-a6ce-efb4e0885c85 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:49 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Neutron deleted interface 80fb2ead-2bbb-41d3-a6ce-efb4e0885c85; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "address": "fa:16:3e:30:ce:e9", "network": {"id": "40cd15ba-4d97-43a0-8ec0-ad2ba0ec3c67", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566536902", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap680b6bd7-ed", "ovs_interfaceid": "680b6bd7-ed4c-46c1-ac8c-4fc537e11894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Detach interface failed, port_id=80fb2ead-2bbb-41d3-a6ce-efb4e0885c85, reason: Instance dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-deleted-2991e3ac-7594-43bd-aa53-f63a10d89df2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:49 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Neutron deleted interface 2991e3ac-7594-43bd-aa53-f63a10d89df2; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3e38161-fe09-4747-af12-b673abc3b159", "address": "fa:16:3e:c7:75:41", "network": {"id": "b85db234-51a6-4a13-ba86-9d39449adc9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-102205501", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e38161-fe", "ovs_interfaceid": "a3e38161-fe09-4747-af12-b673abc3b159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Detach interface failed, port_id=2991e3ac-7594-43bd-aa53-f63a10d89df2, reason: Instance 23781762-45a9-4943-b18e-19f6b8784e32 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-deleted-680b6bd7-ed4c-46c1-ac8c-4fc537e11894 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:49 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Neutron deleted interface 680b6bd7-ed4c-46c1-ac8c-4fc537e11894; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [{"id": "65bd5242-7df3-407c-b280-752f322cd1e8", "address": "fa:16:3e:f1:32:4b", "network": {"id": "404c6e76-d414-46ac-8d67-e28a542474b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-675849910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bd5242-7d", "ovs_interfaceid": "65bd5242-7df3-407c-b280-752f322cd1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "address": "fa:16:3e:22:19:ea", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1345ad0-2b", "ovs_interfaceid": "a1345ad0-2bcd-4bdb-bcac-645d7b498f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "address": "fa:16:3e:d7:47:48", "network": {"id": "20c1c343-a206-4a4d-93f0-1c8c8beb240b", "bridge": "br-int", "label": "tempest-device-tagging-net1-414247011", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3afd6b79ca734255a07a8a9273706ca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bbc7b6-fa", "ovs_interfaceid": "f3bbc7b6-fa80-4857-a289-8690cd7bafdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Detach interface failed, port_id=680b6bd7-ed4c-46c1-ac8c-4fc537e11894, reason: Instance dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-deleted-a3e38161-fe09-4747-af12-b673abc3b159 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:50 user nova-compute[74880]: INFO nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Neutron deleted interface a3e38161-fe09-4747-af12-b673abc3b159; detaching it from the instance and deleting it from the info cache
Nov 15 01:16:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [{"id": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "address": "fa:16:3e:b4:82:44", "network": {"id": "a29d2025-fe80-4da8-b23d-13466e4be6c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1467522122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77ed63-bd", "ovs_interfaceid": "ce77ed63-bd1b-4c4d-8c7f-80f142cad54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "address": "fa:16:3e:6a:1a:0d", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb433bd-a7", "ovs_interfaceid": "dbb433bd-a744-47b9-96d6-13d96cd28aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f45863a-e5c2-4e68-8148-0fc88358f378", "address": "fa:16:3e:86:a1:e6", "network": {"id": "0f360dc6-93e8-4a01-97a7-1a69b8bc030b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1301870713", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0439938f3f1c4f349e26159daa0d3e5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f45863a-e5", "ovs_interfaceid": "8f45863a-e5c2-4e68-8148-0fc88358f378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c6d4daf-3b6c-433b-b6d7-547558b8a2ec req-d954d88f-b821-4e53-9564-92ad7f43c98b service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Detach interface failed, port_id=a3e38161-fe09-4747-af12-b673abc3b159, reason: Instance 23781762-45a9-4943-b18e-19f6b8784e32 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:50 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Took 5.74 seconds to deallocate network for instance.
Nov 15 01:16:50 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:50 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Took 5.48 seconds to deallocate network for instance.
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-738f1393-e239-49c9-8958-875a6b2d2d6c req-32879373-a398-41ab-84f3-c51adbebd881 service nova] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Received event network-vif-deleted-65bd5242-7df3-407c-b280-752f322cd1e8 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-738f1393-e239-49c9-8958-875a6b2d2d6c req-32879373-a398-41ab-84f3-c51adbebd881 service nova] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Received event network-vif-deleted-ce77ed63-bd1b-4c4d-8c7f-80f142cad54b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:16:51 user nova-compute[74880]: INFO nova.compute.claims [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Claim successful on node user
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBGJMxYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:52 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:52 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:52 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c8b7d7-3cfe-4916-b352-6a694fc5277f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:16:52 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba6ebd-fae1-42bd-b40c-3b1b649e6f04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2] added
Nov 15 01:16:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75d9fe-3b02-4a38-9d84-5695df2efe31]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a08a04-54b3-439e-9948-83eece0209c4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBGJMxYf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBGJMxYf" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[98430ac1-04de-4136-8af3-1756d182942c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vBGJMxYf'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a07c90-eb0e-4644-92cd-0ed8c3a90475]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3ab5a-1bcb-416c-8df7-1ed55f48d434]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:52 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:52 user nova-compute[74880]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)
Nov 15 01:16:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:52 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:52 user nova-compute[74880]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)
Nov 15 01:16:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.policy [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54a257f03d0141539db26a7068a9abf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9de312532d4574b08130fdcecdaed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.121s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc796d-d283-4f80-9c56-2c649be7587d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:16:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Creating image(s)
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "/opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "/opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "/opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260]
Nov 15 01:16:52 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14eccd9-5a89-4fa9-845d-b4366bdb4357]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25360ca-30f2-43e0-9249-8dd1af8a6d06]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c (non-flash)
Nov 15 01:16:53 user nova-compute[74880]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)
Nov 15 01:16:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.505s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcddb32-c72a-48ab-9bb9-35fcdaf4a8d3]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBGJMxYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.207s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk 1073741824" returned: 0 in 0.049s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Successfully created port: 6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: INFO nova.compute.manager [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] [instance: dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9] Took 2.98 seconds to detach 3 volumes for instance.
Nov 15 01:16:53 user nova-compute[74880]: INFO nova.compute.manager [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] [instance: 23781762-45a9-4943-b18e-19f6b8784e32] Took 2.99 seconds to detach 3 volumes for instance.
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Cannot resize image /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Ensure instance console log exists: /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:16:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Successfully updated port: 6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "refresh_cache-11ffcf53-7fc2-4394-817c-a14ba034d805" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquired lock "refresh_cache-11ffcf53-7fc2-4394-817c-a14ba034d805" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-changed-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Refreshing instance network info cache due to event network-changed-6aa2ab6c-47f0-44cb-a968-4632ac81e766. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] Acquiring lock "refresh_cache-11ffcf53-7fc2-4394-817c-a14ba034d805" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '23130663638343865', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130663638343865', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.objects.instance [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'flavor' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:16:54 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:54 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:16:54 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:16:54 user nova-compute[74880]:   <serial>8f30ec00-6162-4791-b35b-bf3f1a1c0ca2</serial>
Nov 15 01:16:54 user nova-compute[74880]: </disk>
Nov 15 01:16:54 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.569s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:54 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Deleted allocations for instance 23781762-45a9-4943-b18e-19f6b8784e32
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Updating instance_info_cache with network_info: [{"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a6f5cf30-b637-48b7-9755-cbe05669fd51 tempest-TaggedBootDevicesTest-211578276 tempest-TaggedBootDevicesTest-211578276-project-member] Lock "23781762-45a9-4943-b18e-19f6b8784e32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.950s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Releasing lock "refresh_cache-11ffcf53-7fc2-4394-817c-a14ba034d805" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Instance network_info: |[{"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] Acquired lock "refresh_cache-11ffcf53-7fc2-4394-817c-a14ba034d805" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Refreshing network info cache for port 6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Start _get_guest_xml network_info=[{"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:16:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:16:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-830860037',display_name='tempest-VolumesAdminNegativeTest-server-830860037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-830860037',id=14,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb9de312532d4574b08130fdcecdaed2',ramdisk_id='',reservation_id='r-pn0js0j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-325468300',owner_user_name='tempest-VolumesAdminNegativeTest-325468300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:16:53Z,user_data=None,user_id='54a257f03d0141539db26a7068a9abf9',uuid=11ffcf53-7fc2-4394-817c-a14ba034d805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converting VIF {"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'pci_devices' on Instance uuid 11ffcf53-7fc2-4394-817c-a14ba034d805 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:16:54 user nova-compute[74880]:   <uuid>11ffcf53-7fc2-4394-817c-a14ba034d805</uuid>
Nov 15 01:16:54 user nova-compute[74880]:   <name>instance-0000000e</name>
Nov 15 01:16:54 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:16:54 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:16:54 user nova-compute[74880]:   <metadata>
Nov 15 01:16:54 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:16:54 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:16:54 user nova-compute[74880]:       <nova:name>tempest-VolumesAdminNegativeTest-server-830860037</nova:name>
Nov 15 01:16:54 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:16:54</nova:creationTime>
Nov 15 01:16:54 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:16:54 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:16:54 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:16:54 user nova-compute[74880]:       <nova:owner>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:user uuid="54a257f03d0141539db26a7068a9abf9">tempest-VolumesAdminNegativeTest-325468300-project-member</nova:user>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:project uuid="fb9de312532d4574b08130fdcecdaed2">tempest-VolumesAdminNegativeTest-325468300</nova:project>
Nov 15 01:16:54 user nova-compute[74880]:       </nova:owner>
Nov 15 01:16:54 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:16:54 user nova-compute[74880]:       <nova:ports>
Nov 15 01:16:54 user nova-compute[74880]:         <nova:port uuid="6aa2ab6c-47f0-44cb-a968-4632ac81e766">
Nov 15 01:16:54 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:16:54 user nova-compute[74880]:         </nova:port>
Nov 15 01:16:54 user nova-compute[74880]:       </nova:ports>
Nov 15 01:16:54 user nova-compute[74880]:     </nova:instance>
Nov 15 01:16:54 user nova-compute[74880]:   </metadata>
Nov 15 01:16:54 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:16:54 user nova-compute[74880]:     <system>
Nov 15 01:16:54 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:16:54 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:16:54 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:16:54 user nova-compute[74880]:       <entry name="serial">11ffcf53-7fc2-4394-817c-a14ba034d805</entry>
Nov 15 01:16:54 user nova-compute[74880]:       <entry name="uuid">11ffcf53-7fc2-4394-817c-a14ba034d805</entry>
Nov 15 01:16:54 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:16:54 user nova-compute[74880]:     </system>
Nov 15 01:16:54 user nova-compute[74880]:   </sysinfo>
Nov 15 01:16:54 user nova-compute[74880]:   <os>
Nov 15 01:16:54 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:16:54 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:16:54 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:16:54 user nova-compute[74880]:   </os>
Nov 15 01:16:54 user nova-compute[74880]:   <features>
Nov 15 01:16:54 user nova-compute[74880]:     <acpi/>
Nov 15 01:16:54 user nova-compute[74880]:     <apic/>
Nov 15 01:16:54 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:16:54 user nova-compute[74880]:   </features>
Nov 15 01:16:54 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:16:54 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:16:54 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:16:54 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:16:54 user nova-compute[74880]:   </clock>
Nov 15 01:16:54 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:16:54 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:16:54 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:16:54 user nova-compute[74880]:   </cpu>
Nov 15 01:16:54 user nova-compute[74880]:   <devices>
Nov 15 01:16:54 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:16:54 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:16:54 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk"/>
Nov 15 01:16:54 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:16:54 user nova-compute[74880]:     </disk>
Nov 15 01:16:54 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:16:54 user nova-compute[74880]:       <mac address="fa:16:3e:ae:f5:5b"/>
Nov 15 01:16:54 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:16:54 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:16:54 user nova-compute[74880]:       <target dev="tap6aa2ab6c-47"/>
Nov 15 01:16:54 user nova-compute[74880]:     </interface>
Nov 15 01:16:54 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:16:54 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/console.log" append="off"/>
Nov 15 01:16:54 user nova-compute[74880]:     </serial>
Nov 15 01:16:54 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:16:54 user nova-compute[74880]:     <video>
Nov 15 01:16:54 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:16:54 user nova-compute[74880]:     </video>
Nov 15 01:16:54 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:16:54 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:16:54 user nova-compute[74880]:     </rng>
Nov 15 01:16:54 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:16:54 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:16:54 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:16:54 user nova-compute[74880]:     </memballoon>
Nov 15 01:16:54 user nova-compute[74880]:   </devices>
Nov 15 01:16:54 user nova-compute[74880]: </domain>
Nov 15 01:16:54 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-830860037',display_name='tempest-VolumesAdminNegativeTest-server-830860037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-830860037',id=14,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb9de312532d4574b08130fdcecdaed2',ramdisk_id='',reservation_id='r-pn0js0j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-325468300',owner_user_name='tempest-VolumesAdminNegativeTest-325468300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:16:53Z,user_data=None,user_id='54a257f03d0141539db26a7068a9abf9',uuid=11ffcf53-7fc2-4394-817c-a14ba034d805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converting VIF {"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG os_vif [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3420361c-8d03-5abe-b5ee-4ab9c2ce0b03', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aa2ab6c-47, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6aa2ab6c-47, col_values=(('qos', UUID('054b2925-591c-48c7-9e6c-6a0112f12eb1')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6aa2ab6c-47, col_values=(('external_ids', {'iface-id': '6aa2ab6c-47f0-44cb-a968-4632ac81e766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:f5:5b', 'vm-uuid': '11ffcf53-7fc2-4394-817c-a14ba034d805'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] No VIF found with MAC fa:16:3e:c5:a0:82, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:54 user nova-compute[74880]: INFO os_vif [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47')
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] No VIF found with MAC fa:16:3e:ae:f5:5b, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:54 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-74ae9aaf-57bd-48f5-884d-b969195eb783 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.532s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:16:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7302MB free_disk=25.550472259521484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.063s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.020s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:55 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Deleted allocations for instance dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9
Nov 15 01:16:55 user nova-compute[74880]: INFO nova.compute.manager [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Detaching volume 8f30ec00-6162-4791-b35b-bf3f1a1c0ca2
Nov 15 01:16:55 user nova-compute[74880]: INFO nova.virt.block_device [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attempting to driver detach volume 8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 from mountpoint /dev/vdc
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Updated VIF entry in instance network info cache for port 6aa2ab6c-47f0-44cb-a968-4632ac81e766. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Updating instance_info_cache with network_info: [{"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Attempting to detach device vdc from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:55 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:55 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:16:55 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:16:55 user nova-compute[74880]:   <serial>8f30ec00-6162-4791-b35b-bf3f1a1c0ca2</serial>
Nov 15 01:16:55 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 01:16:55 user nova-compute[74880]: </disk>
Nov 15 01:16:55 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6e345800-68a6-4238-b164-27bd42aed484 req-75a7590e-3e37-4f49-a949-7d9b58f2ae14 service nova] Releasing lock "refresh_cache-11ffcf53-7fc2-4394-817c-a14ba034d805" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-668d2301-14d2-4cab-a31b-e1b25b14f7eb tempest-TaggedBootDevicesTest_v242-5491643 tempest-TaggedBootDevicesTest_v242-5491643-project-member] Lock "dedf05f6-797b-4c32-8f8f-ff5a4b8e6ae9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.574s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Successfully detached device vdc from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the persistent domain config.
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:16:55 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:16:55 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:16:55 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:16:55 user nova-compute[74880]:   <serial>8f30ec00-6162-4791-b35b-bf3f1a1c0ca2</serial>
Nov 15 01:16:55 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 01:16:55 user nova-compute[74880]: </disk>
Nov 15 01:16:55 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance bc155ceb-d7ca-477b-8479-a459fa50af05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ec08677b-c923-4307-855e-c6326dfedf6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8dbd7773-a064-47c0-926f-c12afcb24d7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 026890b4-5a76-4730-bc20-54b95359bdcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d1cff7b2-c988-48d7-9649-ac1b7831ac7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ffcf53-7fc2-4394-817c-a14ba034d805 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:16:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.796s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-fe099ebf-e678-45ec-8f67-f57ce921bed9 req-c6e5ba84-2d2c-400a-a719-0b32bc2a2c5e service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fe099ebf-e678-45ec-8f67-f57ce921bed9 req-c6e5ba84-2d2c-400a-a719-0b32bc2a2c5e service nova] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fe099ebf-e678-45ec-8f67-f57ce921bed9 req-c6e5ba84-2d2c-400a-a719-0b32bc2a2c5e service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fe099ebf-e678-45ec-8f67-f57ce921bed9 req-c6e5ba84-2d2c-400a-a719-0b32bc2a2c5e service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-fe099ebf-e678-45ec-8f67-f57ce921bed9 req-c6e5ba84-2d2c-400a-a719-0b32bc2a2c5e service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] No waiting events found dispatching network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:56 user nova-compute[74880]: WARNING nova.compute.manager [req-fe099ebf-e678-45ec-8f67-f57ce921bed9 req-c6e5ba84-2d2c-400a-a719-0b32bc2a2c5e service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received unexpected event network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 for instance with vm_state building and task_state spawning.
Nov 15 01:16:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:16:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Instance spawned successfully.
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-eb8a1cae-ef35-4018-8e41-8c65fe2b98b6 req-b573a028-9ef7-4f0f-8e45-42e33e7846cd service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-eb8a1cae-ef35-4018-8e41-8c65fe2b98b6 req-b573a028-9ef7-4f0f-8e45-42e33e7846cd service nova] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-eb8a1cae-ef35-4018-8e41-8c65fe2b98b6 req-b573a028-9ef7-4f0f-8e45-42e33e7846cd service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-eb8a1cae-ef35-4018-8e41-8c65fe2b98b6 req-b573a028-9ef7-4f0f-8e45-42e33e7846cd service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-eb8a1cae-ef35-4018-8e41-8c65fe2b98b6 req-b573a028-9ef7-4f0f-8e45-42e33e7846cd service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] No waiting events found dispatching network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:16:58 user nova-compute[74880]: WARNING nova.compute.manager [req-eb8a1cae-ef35-4018-8e41-8c65fe2b98b6 req-b573a028-9ef7-4f0f-8e45-42e33e7846cd service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received unexpected event network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 for instance with vm_state building and task_state spawning.
Nov 15 01:16:58 user nova-compute[74880]: INFO nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 15 01:16:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:16:58 user nova-compute[74880]: INFO nova.compute.manager [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Took 6.83 seconds to build instance.
Nov 15 01:16:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b20143f-f520-483c-a2e9-3474e08c0e56 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.975s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:16:59 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec08677b-c923-4307-855e-c6326dfedf6e is timed out.
Nov 15 01:16:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Successfully detached device vdb from instance ec08677b-c923-4307-855e-c6326dfedf6e from the live domain config.
Nov 15 01:16:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAvowTgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:16:59 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb407f-24be-45f8-9de3-d96ce1d8390c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:16:59 user nova-compute[74880]: No targets found.
Nov 15 01:16:59 user nova-compute[74880]: iSNS:
Nov 15 01:16:59 user nova-compute[74880]: No targets found.
Nov 15 01:16:59 user nova-compute[74880]: STATIC:
Nov 15 01:16:59 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0
Nov 15 01:16:59 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:59 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:59 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805
Nov 15 01:16:59 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:59 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:59 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:16:59 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:59 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:59 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2
Nov 15 01:16:59 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:59 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:59 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c
Nov 15 01:16:59 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:16:59 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:16:59 user nova-compute[74880]: FIRMWARE:
Nov 15 01:16:59 user nova-compute[74880]: No targets found.
Nov 15 01:16:59 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:16:59 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:16:59 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcffd60e-aa99-4eff-8a4a-b3f74846d48f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8732fca9-c023-4ca3-9601-c63a0c42a682]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89bf92d9-a6e1-48a7-9cab-7cae8e7c3805 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e65217-0d27-48db-9868-df65cbcd208c (non-flash)
Nov 15 01:16:59 user nova-compute[74880]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)
Nov 15 01:16:59 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f05232e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0'): ({'sdh'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Removing single pathed devices sdh {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8797788-7319-4452-9b9a-d74b3a0c16f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[49321152-3f46-4389-ba0f-c119c469bbc9]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Flushing IO for device /dev/sdh {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba02c7ef-ff4e-40f5-af8b-20970f908bfb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.055s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd166b-3e41-4393-b7c8-ed8ec0bc8990]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] SCSI volumes sdh have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[845760cc-4265-49f8-8e9b-9148902d1336]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e39ad3-bf9b-4279-8bfd-9f89100d6fa8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260]
Nov 15 01:16:59 user nova-compute[74880]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0, portal: 172.16.0.220,3260] successful.
Nov 15 01:16:59 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:16:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4dcb9b8-3dc1-4188-b95f-78a68ee8c6b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efabcf2-fa20-4602-85eb-e731574c0345]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] <== disconnect_volume: return (358ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lazy-loading 'flavor' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad3a110b-0bca-43e8-a09a-2999681b3df2 tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.135s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:15 user nova-compute[74880]: INFO nova.compute.manager [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Terminating instance
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-2f88314f-9ea3-4d2c-95ca-d0447b5e54f4 req-beb70f08-d872-4c7c-992e-215eb2878584 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-vif-unplugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2f88314f-9ea3-4d2c-95ca-d0447b5e54f4 req-beb70f08-d872-4c7c-992e-215eb2878584 service nova] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2f88314f-9ea3-4d2c-95ca-d0447b5e54f4 req-beb70f08-d872-4c7c-992e-215eb2878584 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2f88314f-9ea3-4d2c-95ca-d0447b5e54f4 req-beb70f08-d872-4c7c-992e-215eb2878584 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-2f88314f-9ea3-4d2c-95ca-d0447b5e54f4 req-beb70f08-d872-4c7c-992e-215eb2878584 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] No waiting events found dispatching network-vif-unplugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-2f88314f-9ea3-4d2c-95ca-d0447b5e54f4 req-beb70f08-d872-4c7c-992e-215eb2878584 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-vif-unplugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Instance destroyed successfully.
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.objects.instance [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lazy-loading 'resources' on Instance uuid 8dbd7773-a064-47c0-926f-c12afcb24d7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1575094192',display_name='tempest-VolumesAssistedSnapshotsTest-server-1575094192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1575094192',id=9,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPCElpx3KL2Fu77voT5DEA4+KNIgNNuRIsQDeOlG+NktRv28ALLLKWyKe+iqMTmJsovzeHil9rU7/NbZXTW3vLnjYG6eG6Tl+uFIBMf1PK8xZYsZwOYCvOdvEgqDZ+WzQ==',key_name='tempest-keypair-29565132',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0d659bf5bd7481abec075ad5fa0236d',ramdisk_id='',reservation_id='r-eiukv822',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1340056055',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1340056055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:14:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9022a7f3c1d74a29adb72b62a479f579',uuid=8dbd7773-a064-47c0-926f-c12afcb24d7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Converting VIF {"id": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "address": "fa:16:3e:70:3c:44", "network": {"id": "171117b2-8746-4fa9-a012-453083076cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1985922413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0d659bf5bd7481abec075ad5fa0236d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a183bba-7c", "ovs_interfaceid": "8a183bba-7c9d-4f2c-9697-34d8caed5c8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG os_vif [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a183bba-7c, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdc305e0-30ca-4a71-80ea-63df428255a2) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:15 user nova-compute[74880]: INFO os_vif [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:3c:44,bridge_name='br-int',has_traffic_filtering=True,id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a,network=Network(171117b2-8746-4fa9-a012-453083076cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a183bba-7c')
Nov 15 01:17:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Deleting instance files /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f_del
Nov 15 01:17:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Deletion of /opt/stack/data/nova/instances/8dbd7773-a064-47c0-926f-c12afcb24d7f_del complete
Nov 15 01:17:15 user nova-compute[74880]: INFO nova.compute.manager [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:17:15 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 026890b4-5a76-4730-bc20-54b95359bdcc is timed out.
Nov 15 01:17:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Successfully detached device vdc from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the live domain config.
Nov 15 01:17:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBGJMxYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:17:15 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:17:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:17:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e254cae7-5bcd-4caf-b8ff-d1c8dfc4fe22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:17:16 user nova-compute[74880]: No targets found.
Nov 15 01:17:16 user nova-compute[74880]: iSNS:
Nov 15 01:17:16 user nova-compute[74880]: No targets found.
Nov 15 01:17:16 user nova-compute[74880]: STATIC:
Nov 15 01:17:16 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:17:16 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:17:16 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:17:16 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2
Nov 15 01:17:16 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:17:16 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:17:16 user nova-compute[74880]: FIRMWARE:
Nov 15 01:17:16 user nova-compute[74880]: No targets found.
Nov 15 01:17:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:17:16 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:17:16 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1eb904-a74c-4c7e-9c2b-8eb6db6abd0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ca0894-e52c-44fc-b3a0-ed9d51c14339]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:16 user nova-compute[74880]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)
Nov 15 01:17:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:16 user nova-compute[74880]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 (non-flash)
Nov 15 01:17:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01d9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5795c4-08f5-4e5f-ae49-c2629705d3d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b5d83-356b-4c50-a542-677e0b642b47]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c337c-a1bb-4207-bab7-a3cc74ab26e5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aa108c-95e8-48ab-a0c0-11e50ea1c022]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[562058f6-40f9-4e55-8aea-99d3940bb7c9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d657c-41b2-44cb-ab9a-af64507d1e7d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260]
Nov 15 01:17:16 user nova-compute[74880]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2, portal: 172.16.0.220,3260] successful.
Nov 15 01:17:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f30ec00-6162-4791-b35b-bf3f1a1c0ca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e2970-81eb-4f7a-93e9-0848c14c5548]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] <== disconnect_volume: return (303ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:16 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Took 0.88 seconds to deallocate network for instance.
Nov 15 01:17:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-da22bf1b-f24d-4358-9eb1-3d0d57516d58 req-86059cce-e29c-4b39-b4fd-ffb7a365dfc4 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-vif-deleted-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:16 user nova-compute[74880]: INFO nova.compute.manager [req-da22bf1b-f24d-4358-9eb1-3d0d57516d58 req-86059cce-e29c-4b39-b4fd-ffb7a365dfc4 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Neutron deleted interface 8a183bba-7c9d-4f2c-9697-34d8caed5c8a; detaching it from the instance and deleting it from the info cache
Nov 15 01:17:16 user nova-compute[74880]: DEBUG nova.network.neutron [req-da22bf1b-f24d-4358-9eb1-3d0d57516d58 req-86059cce-e29c-4b39-b4fd-ffb7a365dfc4 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-da22bf1b-f24d-4358-9eb1-3d0d57516d58 req-86059cce-e29c-4b39-b4fd-ffb7a365dfc4 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Detach interface failed, port_id=8a183bba-7c9d-4f2c-9697-34d8caed5c8a, reason: Instance 8dbd7773-a064-47c0-926f-c12afcb24d7f could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG nova.objects.instance [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'flavor' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-28d38081-a107-4b7e-a588-908d7124b269 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:17 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Deleted allocations for instance 8dbd7773-a064-47c0-926f-c12afcb24d7f
Nov 15 01:17:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-5d9211ee-01a0-4b57-9278-1ab720fce44b req-04a2154e-68d8-4826-ac57-81546edb4253 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received event network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5d9211ee-01a0-4b57-9278-1ab720fce44b req-04a2154e-68d8-4826-ac57-81546edb4253 service nova] Acquiring lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5d9211ee-01a0-4b57-9278-1ab720fce44b req-04a2154e-68d8-4826-ac57-81546edb4253 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5d9211ee-01a0-4b57-9278-1ab720fce44b req-04a2154e-68d8-4826-ac57-81546edb4253 service nova] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-5d9211ee-01a0-4b57-9278-1ab720fce44b req-04a2154e-68d8-4826-ac57-81546edb4253 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] No waiting events found dispatching network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:17 user nova-compute[74880]: WARNING nova.compute.manager [req-5d9211ee-01a0-4b57-9278-1ab720fce44b req-04a2154e-68d8-4826-ac57-81546edb4253 service nova] [instance: 8dbd7773-a064-47c0-926f-c12afcb24d7f] Received unexpected event network-vif-plugged-8a183bba-7c9d-4f2c-9697-34d8caed5c8a for instance with vm_state deleted and task_state None.
Nov 15 01:17:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-79cb0175-3264-4faa-87f0-bac74dfbe6bb tempest-VolumesAssistedSnapshotsTest-1340056055 tempest-VolumesAssistedSnapshotsTest-1340056055-project-member] Lock "8dbd7773-a064-47c0-926f-c12afcb24d7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.362s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:20 user nova-compute[74880]: INFO nova.compute.manager [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Terminating instance
Nov 15 01:17:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-593af373-72b4-4bc1-aca8-00e729e5d639 req-4f406174-93cc-44d0-9656-0dcea6977b9c service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-vif-unplugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-593af373-72b4-4bc1-aca8-00e729e5d639 req-4f406174-93cc-44d0-9656-0dcea6977b9c service nova] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-593af373-72b4-4bc1-aca8-00e729e5d639 req-4f406174-93cc-44d0-9656-0dcea6977b9c service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-593af373-72b4-4bc1-aca8-00e729e5d639 req-4f406174-93cc-44d0-9656-0dcea6977b9c service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-593af373-72b4-4bc1-aca8-00e729e5d639 req-4f406174-93cc-44d0-9656-0dcea6977b9c service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] No waiting events found dispatching network-vif-unplugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-593af373-72b4-4bc1-aca8-00e729e5d639 req-4f406174-93cc-44d0-9656-0dcea6977b9c service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-vif-unplugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Instance destroyed successfully.
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lazy-loading 'resources' on Instance uuid d1cff7b2-c988-48d7-9649-ac1b7831ac7f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-926616564',display_name='tempest-ServersNegativeTestJSON-server-926616564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-926616564',id=13,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b89fc20cea474b93164a63cbc4c3e4',ramdisk_id='',reservation_id='r-zf2aduen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1657617311',owner_user_name='tempest-ServersNegativeTestJSON-1657617311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:38Z,user_data=None,user_id='9de13732bcf04ab98686accb51cd4af4',uuid=d1cff7b2-c988-48d7-9649-ac1b7831ac7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converting VIF {"id": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "address": "fa:16:3e:1b:21:a7", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f604ee9-a0", "ovs_interfaceid": "2f604ee9-a0f9-49c2-827c-9ca6b905a34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG os_vif [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f604ee9-a0, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d782230f-a0dd-4e02-8524-c409e174c315) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: INFO os_vif [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f604ee9-a0')
Nov 15 01:17:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Deleting instance files /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f_del
Nov 15 01:17:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Deletion of /opt/stack/data/nova/instances/d1cff7b2-c988-48d7-9649-ac1b7831ac7f_del complete
Nov 15 01:17:21 user nova-compute[74880]: INFO nova.compute.manager [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 01:17:21 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-2c0765ba-ba75-424b-b246-831d0309b6f5 req-907cbafe-7c6f-469f-a20d-d680881d5939 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-vif-deleted-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:21 user nova-compute[74880]: INFO nova.compute.manager [req-2c0765ba-ba75-424b-b246-831d0309b6f5 req-907cbafe-7c6f-469f-a20d-d680881d5939 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Neutron deleted interface 2f604ee9-a0f9-49c2-827c-9ca6b905a34e; detaching it from the instance and deleting it from the info cache
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.network.neutron [req-2c0765ba-ba75-424b-b246-831d0309b6f5 req-907cbafe-7c6f-469f-a20d-d680881d5939 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:21 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Took 0.46 seconds to deallocate network for instance.
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-2c0765ba-ba75-424b-b246-831d0309b6f5 req-907cbafe-7c6f-469f-a20d-d680881d5939 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Detach interface failed, port_id=2f604ee9-a0f9-49c2-827c-9ca6b905a34e, reason: Instance d1cff7b2-c988-48d7-9649-ac1b7831ac7f could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:17:21 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:17:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:22 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Deleted allocations for instance d1cff7b2-c988-48d7-9649-ac1b7831ac7f
Nov 15 01:17:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4b90710-385e-4431-9c2f-cc67771b77ab tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.688s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-20de48ce-6043-4016-8470-f61a3846f4d1 req-0d305ffe-2115-42f9-b928-f9ddb0201343 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received event network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-20de48ce-6043-4016-8470-f61a3846f4d1 req-0d305ffe-2115-42f9-b928-f9ddb0201343 service nova] Acquiring lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-20de48ce-6043-4016-8470-f61a3846f4d1 req-0d305ffe-2115-42f9-b928-f9ddb0201343 service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-20de48ce-6043-4016-8470-f61a3846f4d1 req-0d305ffe-2115-42f9-b928-f9ddb0201343 service nova] Lock "d1cff7b2-c988-48d7-9649-ac1b7831ac7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-20de48ce-6043-4016-8470-f61a3846f4d1 req-0d305ffe-2115-42f9-b928-f9ddb0201343 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] No waiting events found dispatching network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:22 user nova-compute[74880]: WARNING nova.compute.manager [req-20de48ce-6043-4016-8470-f61a3846f4d1 req-0d305ffe-2115-42f9-b928-f9ddb0201343 service nova] [instance: d1cff7b2-c988-48d7-9649-ac1b7831ac7f] Received unexpected event network-vif-plugged-2f604ee9-a0f9-49c2-827c-9ca6b905a34e for instance with vm_state deleted and task_state None.
Nov 15 01:17:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:29 user nova-compute[74880]: INFO nova.compute.manager [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Terminating instance
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-3991be2a-0320-4273-bdb8-ea2b45e0418a req-4a13219d-36d2-4b3e-9592-bbd83b3e0ffc service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-vif-unplugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3991be2a-0320-4273-bdb8-ea2b45e0418a req-4a13219d-36d2-4b3e-9592-bbd83b3e0ffc service nova] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3991be2a-0320-4273-bdb8-ea2b45e0418a req-4a13219d-36d2-4b3e-9592-bbd83b3e0ffc service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3991be2a-0320-4273-bdb8-ea2b45e0418a req-4a13219d-36d2-4b3e-9592-bbd83b3e0ffc service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-3991be2a-0320-4273-bdb8-ea2b45e0418a req-4a13219d-36d2-4b3e-9592-bbd83b3e0ffc service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] No waiting events found dispatching network-vif-unplugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-3991be2a-0320-4273-bdb8-ea2b45e0418a req-4a13219d-36d2-4b3e-9592-bbd83b3e0ffc service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-vif-unplugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:17:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Instance destroyed successfully.
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.objects.instance [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lazy-loading 'resources' on Instance uuid ec08677b-c923-4307-855e-c6326dfedf6e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-355533538',display_name='tempest-TestVolumeSwap-server-355533538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-355533538',id=8,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7ibjxx6ag/J4385qS/22g0sLzcL5Cpad/XEpD5hQe+OhBzc4OqjEoj2D2MotKbZjhklWsL71vRHcSlQ0vfaM85jcxTGWE3+47oXTBtQNcB0uZ7ra52ObVXUJKL2ytwMw==',key_name='tempest-keypair-637086337',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bb57a1bb274bbda3c9f0ffffc67762',ramdisk_id='',reservation_id='r-1vfp3ws0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1403746086',owner_user_name='tempest-TestVolumeSwap-1403746086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f40427608ceb483da72faee674ab92a6',uuid=ec08677b-c923-4307-855e-c6326dfedf6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Converting VIF {"id": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "address": "fa:16:3e:5f:e2:d7", "network": {"id": "6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1628531364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bb57a1bb274bbda3c9f0ffffc67762", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33f0e62-8a", "ovs_interfaceid": "f33f0e62-8afe-4b3c-be48-26e9037c4193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG os_vif [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf33f0e62-8a, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=719fb5ef-28e5-44e2-af3e-34c31db68a6a) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:29 user nova-compute[74880]: INFO os_vif [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e2:d7,bridge_name='br-int',has_traffic_filtering=True,id=f33f0e62-8afe-4b3c-be48-26e9037c4193,network=Network(6cad4924-3de8-4fb3-9ac0-8ec8ee94f87e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33f0e62-8a')
Nov 15 01:17:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Deleting instance files /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e_del
Nov 15 01:17:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Deletion of /opt/stack/data/nova/instances/ec08677b-c923-4307-855e-c6326dfedf6e_del complete
Nov 15 01:17:30 user nova-compute[74880]: INFO nova.compute.manager [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 01:17:30 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:17:30 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:17:30 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'flavor' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:31 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Took 1.56 seconds to deallocate network for instance.
Nov 15 01:17:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-0acf40bf-627c-45a3-ad8c-82a0a2a5e7da req-1bbafb75-a3a8-4061-bbc9-33ba77ed5b72 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-vif-deleted-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fc43ffe-431d-4aee-9222-e193b6394b75 req-e84d7f17-5bab-4e10-9db4-46bb7a900610 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received event network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fc43ffe-431d-4aee-9222-e193b6394b75 req-e84d7f17-5bab-4e10-9db4-46bb7a900610 service nova] Acquiring lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fc43ffe-431d-4aee-9222-e193b6394b75 req-e84d7f17-5bab-4e10-9db4-46bb7a900610 service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fc43ffe-431d-4aee-9222-e193b6394b75 req-e84d7f17-5bab-4e10-9db4-46bb7a900610 service nova] Lock "ec08677b-c923-4307-855e-c6326dfedf6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fc43ffe-431d-4aee-9222-e193b6394b75 req-e84d7f17-5bab-4e10-9db4-46bb7a900610 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] No waiting events found dispatching network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:31 user nova-compute[74880]: WARNING nova.compute.manager [req-7fc43ffe-431d-4aee-9222-e193b6394b75 req-e84d7f17-5bab-4e10-9db4-46bb7a900610 service nova] [instance: ec08677b-c923-4307-855e-c6326dfedf6e] Received unexpected event network-vif-plugged-f33f0e62-8afe-4b3c-be48-26e9037c4193 for instance with vm_state deleted and task_state None.
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:31 user nova-compute[74880]: INFO nova.compute.manager [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Attaching volume 88a0212f-eae8-4d8b-adfa-bde57ca00e4e to /dev/vdb
Nov 15 01:17:31 user nova-compute[74880]: DEBUG os_brick.utils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c579b4-526a-4113-8f1e-34aa3680135c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9abcf3-c9f0-4831-b8d4-9eab56f9d5a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f064dbf5-a5dc-43d0-85f3-fde4b09f627a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[445e3cf4-d207-47aa-b1c1-1f5cac74256e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:17:31 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:17:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f429dff5-e1d5-445f-a78b-c1816c117be3]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG os_brick.utils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:17:31 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating existing volume attachment record: 1090b6a1-a919-4a9c-ba86-d8ea43334f12 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:17:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:32 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:17:32 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:17:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:32 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Deleted allocations for instance ec08677b-c923-4307-855e-c6326dfedf6e
Nov 15 01:17:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df48d949-e2d3-4431-ba73-d3e1144942da tempest-TestVolumeSwap-1403746086 tempest-TestVolumeSwap-1403746086-project-member] Lock "ec08677b-c923-4307-855e-c6326dfedf6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.195s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:17:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:35 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:17:35 user nova-compute[74880]: INFO nova.compute.claims [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Claim successful on node user
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:17:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.policy [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b04e9fd63942fb9279c26ddeec3acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3350f1780d5464dae7c3eca61375446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:17:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Creating image(s)
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk 1073741824" returned: 0 in 0.076s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exnKzCRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:17:37 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:17:37 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:17:37 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Successfully created port: b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.248s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e17c3-21c7-4bad-8db1-97c61105c89a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:17:37 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d325cbd-70a9-4064-aa32-55772a324b60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e] added
Nov 15 01:17:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c729b42f-b445-46c6-85a2-b40ab9ca7b68]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe705c5-7c2a-4a0c-812b-df814fe335c9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exnKzCRT {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exnKzCRT" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64350546-144f-45d9-8e62-46bc550e0c57]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'exnKzCRT'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac2e89-721e-4636-8989-8dd4923c25f6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Cannot resize image /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Ensure instance console log exists: /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c7a72-99df-475c-89ff-7a318db70533]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e8f61-0b9a-41dd-bcba-eef85c01807b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260]
Nov 15 01:17:37 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260] successful.
Nov 15 01:17:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[847ad8fe-9d68-4657-bbaf-8ae88e853e6f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e767795-1923-457f-be47-9c5dd4c38c91]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:37 user nova-compute[74880]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:17:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:37 user nova-compute[74880]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:17:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b9a6a-b814-4b1b-9ed4-247af6127e47]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Successfully updated port: b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquired lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-changed-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Refreshing instance network info cache due to event network-changed-b42a9438-2c45-46c5-8a25-f0afc867d4bb. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:17:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] Acquiring lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updating instance_info_cache with network_info: [{"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Releasing lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance network_info: |[{"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] Acquired lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Refreshing network info cache for port b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Start _get_guest_xml network_info=[{"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:17:38 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:38 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344540292',display_name='tempest-tempest.common.compute-instance-344540292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344540292',id=15,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30jO300DrwUN098zh7bTwkPEW0mV1Sl0lx8TlUkml7xDrjGooFZ46Urb83LosU78QkZtWenFmhVocTMQdNZO5q9PR3uzOnDyYcztQ/xZkcTN/+SDQcR7plYcLy61Q/WQ==',key_name='tempest-keypair-833480284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-d786i2pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=2a7118ff-95dc-4cf1-a892-5ab701a1600e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:17:38 user nova-compute[74880]:   <uuid>2a7118ff-95dc-4cf1-a892-5ab701a1600e</uuid>
Nov 15 01:17:38 user nova-compute[74880]:   <name>instance-0000000f</name>
Nov 15 01:17:38 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:17:38 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:17:38 user nova-compute[74880]:   <metadata>
Nov 15 01:17:38 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:17:38 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:17:38 user nova-compute[74880]:       <nova:name>tempest-tempest.common.compute-instance-344540292</nova:name>
Nov 15 01:17:38 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:17:38</nova:creationTime>
Nov 15 01:17:38 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:17:38 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:17:38 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:17:38 user nova-compute[74880]:       <nova:owner>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:user uuid="c0b04e9fd63942fb9279c26ddeec3acc">tempest-ServerActionsTestOtherA-1659960630-project-member</nova:user>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:project uuid="d3350f1780d5464dae7c3eca61375446">tempest-ServerActionsTestOtherA-1659960630</nova:project>
Nov 15 01:17:38 user nova-compute[74880]:       </nova:owner>
Nov 15 01:17:38 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:17:38 user nova-compute[74880]:       <nova:ports>
Nov 15 01:17:38 user nova-compute[74880]:         <nova:port uuid="b42a9438-2c45-46c5-8a25-f0afc867d4bb">
Nov 15 01:17:38 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:17:38 user nova-compute[74880]:         </nova:port>
Nov 15 01:17:38 user nova-compute[74880]:       </nova:ports>
Nov 15 01:17:38 user nova-compute[74880]:     </nova:instance>
Nov 15 01:17:38 user nova-compute[74880]:   </metadata>
Nov 15 01:17:38 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:17:38 user nova-compute[74880]:     <system>
Nov 15 01:17:38 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:17:38 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:17:38 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:17:38 user nova-compute[74880]:       <entry name="serial">2a7118ff-95dc-4cf1-a892-5ab701a1600e</entry>
Nov 15 01:17:38 user nova-compute[74880]:       <entry name="uuid">2a7118ff-95dc-4cf1-a892-5ab701a1600e</entry>
Nov 15 01:17:38 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:17:38 user nova-compute[74880]:     </system>
Nov 15 01:17:38 user nova-compute[74880]:   </sysinfo>
Nov 15 01:17:38 user nova-compute[74880]:   <os>
Nov 15 01:17:38 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:17:38 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:17:38 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:17:38 user nova-compute[74880]:   </os>
Nov 15 01:17:38 user nova-compute[74880]:   <features>
Nov 15 01:17:38 user nova-compute[74880]:     <acpi/>
Nov 15 01:17:38 user nova-compute[74880]:     <apic/>
Nov 15 01:17:38 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:17:38 user nova-compute[74880]:   </features>
Nov 15 01:17:38 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:17:38 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:17:38 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:17:38 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:17:38 user nova-compute[74880]:   </clock>
Nov 15 01:17:38 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:17:38 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:17:38 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:17:38 user nova-compute[74880]:   </cpu>
Nov 15 01:17:38 user nova-compute[74880]:   <devices>
Nov 15 01:17:38 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:17:38 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:17:38 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk"/>
Nov 15 01:17:38 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:17:38 user nova-compute[74880]:     </disk>
Nov 15 01:17:38 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:17:38 user nova-compute[74880]:       <mac address="fa:16:3e:52:70:a5"/>
Nov 15 01:17:38 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:17:38 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:17:38 user nova-compute[74880]:       <target dev="tapb42a9438-2c"/>
Nov 15 01:17:38 user nova-compute[74880]:     </interface>
Nov 15 01:17:38 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:17:38 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/console.log" append="off"/>
Nov 15 01:17:38 user nova-compute[74880]:     </serial>
Nov 15 01:17:38 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:17:38 user nova-compute[74880]:     <video>
Nov 15 01:17:38 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:17:38 user nova-compute[74880]:     </video>
Nov 15 01:17:38 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:17:38 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:17:38 user nova-compute[74880]:     </rng>
Nov 15 01:17:38 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:17:38 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:17:38 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:17:38 user nova-compute[74880]:     </memballoon>
Nov 15 01:17:38 user nova-compute[74880]:   </devices>
Nov 15 01:17:38 user nova-compute[74880]: </domain>
Nov 15 01:17:38 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344540292',display_name='tempest-tempest.common.compute-instance-344540292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344540292',id=15,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30jO300DrwUN098zh7bTwkPEW0mV1Sl0lx8TlUkml7xDrjGooFZ46Urb83LosU78QkZtWenFmhVocTMQdNZO5q9PR3uzOnDyYcztQ/xZkcTN/+SDQcR7plYcLy61Q/WQ==',key_name='tempest-keypair-833480284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-d786i2pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=2a7118ff-95dc-4cf1-a892-5ab701a1600e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG os_vif [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74cdc444-0649-5c01-8c48-fe1dc6ee4164', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exnKzCRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26361653064653865', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361653064653865', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb42a9438-2c, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb42a9438-2c, col_values=(('qos', UUID('566eb667-8f7c-423d-9cb0-abeab710b801')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb42a9438-2c, col_values=(('external_ids', {'iface-id': 'b42a9438-2c45-46c5-8a25-f0afc867d4bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:70:a5', 'vm-uuid': '2a7118ff-95dc-4cf1-a892-5ab701a1600e'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'flavor' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:38 user nova-compute[74880]: INFO os_vif [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c')
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:17:38 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:17:38 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:17:38 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:17:38 user nova-compute[74880]:   <serial>88a0212f-eae8-4d8b-adfa-bde57ca00e4e</serial>
Nov 15 01:17:38 user nova-compute[74880]: </disk>
Nov 15 01:17:38 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No VIF found with MAC fa:16:3e:52:70:a5, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updated VIF entry in instance network info cache for port b42a9438-2c45-46c5-8a25-f0afc867d4bb. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updating instance_info_cache with network_info: [{"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-148a60b9-a7a3-4242-8fda-f190ef75142c req-dade85aa-1d5f-49e1-adea-67bf77a7bf6e service nova] Releasing lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:17:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No VIF found with MAC fa:16:3e:33:94:c9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:17:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7010c975-14a6-432f-8abd-024307b0968a tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.425s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:39 user nova-compute[74880]: INFO nova.compute.manager [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Rescuing
Nov 15 01:17:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:17:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:17:39 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-336bbda5-5efe-42a9-a8e7-c1dea07cf2b1 req-cc86cb53-c9d0-47e7-a650-daa183c39a31 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-336bbda5-5efe-42a9-a8e7-c1dea07cf2b1 req-cc86cb53-c9d0-47e7-a650-daa183c39a31 service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-336bbda5-5efe-42a9-a8e7-c1dea07cf2b1 req-cc86cb53-c9d0-47e7-a650-daa183c39a31 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-336bbda5-5efe-42a9-a8e7-c1dea07cf2b1 req-cc86cb53-c9d0-47e7-a650-daa183c39a31 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-336bbda5-5efe-42a9-a8e7-c1dea07cf2b1 req-cc86cb53-c9d0-47e7-a650-daa183c39a31 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:40 user nova-compute[74880]: WARNING nova.compute.manager [req-336bbda5-5efe-42a9-a8e7-c1dea07cf2b1 req-cc86cb53-c9d0-47e7-a650-daa183c39a31 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state building and task_state spawning.
Nov 15 01:17:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-c35b4e62-7ea1-420a-a63f-c4beb6c38f49 req-d0e24f1e-eff0-42e9-9f47-141a413a37b9 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c35b4e62-7ea1-420a-a63f-c4beb6c38f49 req-d0e24f1e-eff0-42e9-9f47-141a413a37b9 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c35b4e62-7ea1-420a-a63f-c4beb6c38f49 req-d0e24f1e-eff0-42e9-9f47-141a413a37b9 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c35b4e62-7ea1-420a-a63f-c4beb6c38f49 req-d0e24f1e-eff0-42e9-9f47-141a413a37b9 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-c35b4e62-7ea1-420a-a63f-c4beb6c38f49 req-d0e24f1e-eff0-42e9-9f47-141a413a37b9 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:41 user nova-compute[74880]: WARNING nova.compute.manager [req-c35b4e62-7ea1-420a-a63f-c4beb6c38f49 req-d0e24f1e-eff0-42e9-9f47-141a413a37b9 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state active and task_state rescuing.
Nov 15 01:17:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance destroyed successfully.
Nov 15 01:17:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Attempting a stable device rescue
Nov 15 01:17:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74880) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:17:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Creating image(s)
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "75a326e8e173f6cb9a0ef08059a2143dd164ae55" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "75a326e8e173f6cb9a0ef08059a2143dd164ae55" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fc2ac79-c590-4931-b418-6323fc0d8f5e req-50a39060-1cb3-46cf-97ef-d860622095ff service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fc2ac79-c590-4931-b418-6323fc0d8f5e req-50a39060-1cb3-46cf-97ef-d860622095ff service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fc2ac79-c590-4931-b418-6323fc0d8f5e req-50a39060-1cb3-46cf-97ef-d860622095ff service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fc2ac79-c590-4931-b418-6323fc0d8f5e req-50a39060-1cb3-46cf-97ef-d860622095ff service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fc2ac79-c590-4931-b418-6323fc0d8f5e req-50a39060-1cb3-46cf-97ef-d860622095ff service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:43 user nova-compute[74880]: WARNING nova.compute.manager [req-7fc2ac79-c590-4931-b418-6323fc0d8f5e req-50a39060-1cb3-46cf-97ef-d860622095ff service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state building and task_state spawning.
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:17:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance spawned successfully.
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.images [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] aa56d3a7-4865-496b-9e58-075dba99025c was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.part /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:43 user nova-compute[74880]: INFO nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-03face84-4d0b-4eac-be1b-b0c87085e42e req-4ac618bc-7393-4e02-b81b-37146f937a26 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-03face84-4d0b-4eac-be1b-b0c87085e42e req-4ac618bc-7393-4e02-b81b-37146f937a26 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-03face84-4d0b-4eac-be1b-b0c87085e42e req-4ac618bc-7393-4e02-b81b-37146f937a26 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-03face84-4d0b-4eac-be1b-b0c87085e42e req-4ac618bc-7393-4e02-b81b-37146f937a26 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-03face84-4d0b-4eac-be1b-b0c87085e42e req-4ac618bc-7393-4e02-b81b-37146f937a26 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:43 user nova-compute[74880]: WARNING nova.compute.manager [req-03face84-4d0b-4eac-be1b-b0c87085e42e req-4ac618bc-7393-4e02-b81b-37146f937a26 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state active and task_state rescuing.
Nov 15 01:17:43 user nova-compute[74880]: INFO nova.compute.manager [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Took 7.85 seconds to build instance.
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d02e52bc-0879-4256-b7b6-73ae95f17159 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.960s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.part /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.converted" returned: 0 in 0.302s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "75a326e8e173f6cb9a0ef08059a2143dd164ae55" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.785s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "75a326e8e173f6cb9a0ef08059a2143dd164ae55" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "75a326e8e173f6cb9a0ef08059a2143dd164ae55" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55 --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55,backing_fmt=raw /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55,backing_fmt=raw /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue" returned: 0 in 0.049s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "75a326e8e173f6cb9a0ef08059a2143dd164ae55" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'migration_context' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.objects.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Object Instance<3afca469-a0b7-4b07-a28a-ead0e367761e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Start _get_guest_xml network_info=[{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "vif_mac": "fa:16:3e:33:94:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aa56d3a7-4865-496b-9e58-075dba99025c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exnKzCRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3afca469-a0b7-4b07-a28a-ead0e367761e', 'attached_at': '', 'detached_at': '', 'volume_id': '88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'serial': '88a0212f-eae8-4d8b-adfa-bde57ca00e4e'}, 'mount_device': '/dev/vdb', 'attachment_id': '1090b6a1-a919-4a9c-ba86-d8ea43334f12', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'resources' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.objects.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Object Instance<3afca469-a0b7-4b07-a28a-ead0e367761e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:17:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'numa_topology' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.objects.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Object Instance<3afca469-a0b7-4b07-a28a-ead0e367761e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:17:44 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:44 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.objects.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Object Instance<3afca469-a0b7-4b07-a28a-ead0e367761e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exnKzCRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:17:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:17:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:17:44 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eeec5e-7ee7-41be-b634-4f05a303bcf2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = exnKzCRT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 01:17:44 user nova-compute[74880]: node.name = iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:17:44 user nova-compute[74880]: node.tpgt = -1
Nov 15 01:17:44 user nova-compute[74880]: node.startup = automatic
Nov 15 01:17:44 user nova-compute[74880]: node.leading_login = No
Nov 15 01:17:44 user nova-compute[74880]: iface.iscsi_ifacename = default
Nov 15 01:17:44 user nova-compute[74880]: iface.net_ifacename = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.ipaddress = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.prefix_len = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.hwaddress = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.transport_name = tcp
Nov 15 01:17:44 user nova-compute[74880]: iface.initiatorname = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.vlan_id = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.vlan_priority = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.vlan_state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.iface_num = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.mtu = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.port = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.bootproto = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.subnet_mask = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.gateway = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_alt_client_id = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_dns = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_learn_iqn = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_vendor_id_state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_vendor_id = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.dhcp_slp_da = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.fragmentation = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.gratuitous_arp = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.incoming_forwarding = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.tos_state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.tos = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.ttl = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.delayed_ack = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.tcp_nagle = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.tcp_wsf_state = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.tcp_wsf = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.tcp_timer_scale = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.tcp_timestamp = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.redirect = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.def_task_mgmt_timeout = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.header_digest = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.data_digest = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.immediate_data = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.initial_r2t = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.data_seq_inorder = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.data_pdu_inorder = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.erl = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.max_receive_data_len = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.first_burst_len = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.max_outstanding_r2t = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.max_burst_len = 0
Nov 15 01:17:44 user nova-compute[74880]: iface.chap_auth = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.bidi_chap = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.strict_login_compliance = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.discovery_auth = <empty>
Nov 15 01:17:44 user nova-compute[74880]: iface.discovery_logout = <empty>
Nov 15 01:17:44 user nova-compute[74880]: node.discovery_address = <empty>
Nov 15 01:17:44 user nova-compute[74880]: node.discovery_port = 0
Nov 15 01:17:44 user nova-compute[74880]: node.discovery_type = static
Nov 15 01:17:44 user nova-compute[74880]: node.session.initial_cmdsn = 0
Nov 15 01:17:44 user nova-compute[74880]: node.session.initial_login_retry_max = 8
Nov 15 01:17:44 user nova-compute[74880]: node.session.xmit_thread_priority = -20
Nov 15 01:17:44 user nova-compute[74880]: node.session.cmds_max = 128
Nov 15 01:17:44 user nova-compute[74880]: node.session.queue_depth = 32
Nov 15 01:17:44 user nova-compute[74880]: node.session.nr_sessions = 1
Nov 15 01:17:44 user nova-compute[74880]: node.session.auth.authmethod = CHAP
Nov 15 01:17:44 user nova-compute[74880]: node.session.auth.username = exnKzCRT
Nov 15 01:17:44 user nova-compute[74880]: node.session.auth.password = ***
Nov 15 01:17:44 user nova-compute[74880]: node.session.auth.username_in = <empty>
Nov 15 01:17:44 user nova-compute[74880]: node.session.auth.password_in = <empty>
Nov 15 01:17:44 user nova-compute[74880]: node.session.auth.chap_algs = MD5
Nov 15 01:17:44 user nova-compute[74880]: node.session.timeo.replacement_timeout = 120
Nov 15 01:17:44 user nova-compute[74880]: node.session.err_timeo.abort_timeout = 15
Nov 15 01:17:44 user nova-compute[74880]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 01:17:44 user nova-compute[74880]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 01:17:44 user nova-compute[74880]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.FastAbort = Yes
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.InitialR2T = No
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.ImmediateData = Yes
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.MaxConnections = 1
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 01:17:44 user nova-compute[74880]: node.session.iscsi.ERL = 0
Nov 15 01:17:44 user nova-compute[74880]: node.session.scan = manual
Nov 15 01:17:44 user nova-compute[74880]: node.session.reopen_max = 0
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].address = 172.16.0.220
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].port = 3260
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].startup = manual
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].tcp.window_size = 524288
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].tcp.type_of_service = 0
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].timeo.logout_timeout = 15
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].timeo.login_timeout = 15
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].timeo.auth_timeout = 45
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].iscsi.DataDigest = None
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].iscsi.IFMarker = No
Nov 15 01:17:44 user nova-compute[74880]: node.conn[0].iscsi.OFMarker = No
Nov 15 01:17:44 user nova-compute[74880]: # END RECORD
Nov 15 01:17:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeebb10-eefc-4f3e-9ba2-23ca90c8560b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6578020-2f68-4800-9129-55373d887d1b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exnKzCRT {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exnKzCRT" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[625ac6e3-5e1e-4be9-a96e-dabdee316914]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'exnKzCRT'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ddda7-c516-480b-8079-7fa6aa76d989]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b2bf35-25e8-4b99-9e4e-52e1493a1047]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:44 user nova-compute[74880]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:17:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:17:44 user nova-compute[74880]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:17:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] HCTL ('33', '0', '0', 0) found on session 19 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1684e2b-a504-44ab-888b-6c80d01f8c6d]: (4, ('0 0 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Searching for a device in session 19 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exnKzCRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '26361653064653865', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361653064653865', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450655807',display_name='tempest-ServerStableDeviceRescueTest-server-450655807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450655807',id=4,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwrMEmNQ+OaLi5r3RGsdmAtnyiEwn6jhXz3iS4rtV/A0KBwCaS4ZTGXRJOA4jmkHs5PWFr+TFCwFtoDdgR5ofHFaKv0cilr24NRRQIMilzrnFRuY0t/mMgCD9nTrkR+zg==',key_name='tempest-keypair-2106614665',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f4176dcde484c0d865259c76ca9f617',ramdisk_id='',reservation_id='r-4jzevtae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-201731109',owner_user_name='tempest-ServerStableDeviceRescueTest-201731109-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403f23eeef274791a992f05e07b272b7',uuid=3afca469-a0b7-4b07-a28a-ead0e367761e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "vif_mac": "fa:16:3e:33:94:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converting VIF {"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "vif_mac": "fa:16:3e:33:94:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'pci_devices' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.objects.base [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Object Instance<3afca469-a0b7-4b07-a28a-ead0e367761e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:17:44 user nova-compute[74880]:   <uuid>3afca469-a0b7-4b07-a28a-ead0e367761e</uuid>
Nov 15 01:17:44 user nova-compute[74880]:   <name>instance-00000004</name>
Nov 15 01:17:44 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:17:44 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:17:44 user nova-compute[74880]:   <metadata>
Nov 15 01:17:44 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:17:44 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:17:44 user nova-compute[74880]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-450655807</nova:name>
Nov 15 01:17:44 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:17:44</nova:creationTime>
Nov 15 01:17:44 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:17:44 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:17:44 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:17:44 user nova-compute[74880]:       <nova:owner>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:user uuid="403f23eeef274791a992f05e07b272b7">tempest-ServerStableDeviceRescueTest-201731109-project-member</nova:user>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:project uuid="6f4176dcde484c0d865259c76ca9f617">tempest-ServerStableDeviceRescueTest-201731109</nova:project>
Nov 15 01:17:44 user nova-compute[74880]:       </nova:owner>
Nov 15 01:17:44 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:17:44 user nova-compute[74880]:       <nova:ports>
Nov 15 01:17:44 user nova-compute[74880]:         <nova:port uuid="9328a08d-3dad-4b21-9a7c-94361d28d20b">
Nov 15 01:17:44 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 01:17:44 user nova-compute[74880]:         </nova:port>
Nov 15 01:17:44 user nova-compute[74880]:       </nova:ports>
Nov 15 01:17:44 user nova-compute[74880]:     </nova:instance>
Nov 15 01:17:44 user nova-compute[74880]:   </metadata>
Nov 15 01:17:44 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:17:44 user nova-compute[74880]:     <system>
Nov 15 01:17:44 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:17:44 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:17:44 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:17:44 user nova-compute[74880]:       <entry name="serial">3afca469-a0b7-4b07-a28a-ead0e367761e</entry>
Nov 15 01:17:44 user nova-compute[74880]:       <entry name="uuid">3afca469-a0b7-4b07-a28a-ead0e367761e</entry>
Nov 15 01:17:44 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:17:44 user nova-compute[74880]:     </system>
Nov 15 01:17:44 user nova-compute[74880]:   </sysinfo>
Nov 15 01:17:44 user nova-compute[74880]:   <os>
Nov 15 01:17:44 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:17:44 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:17:44 user nova-compute[74880]:   </os>
Nov 15 01:17:44 user nova-compute[74880]:   <features>
Nov 15 01:17:44 user nova-compute[74880]:     <acpi/>
Nov 15 01:17:44 user nova-compute[74880]:     <apic/>
Nov 15 01:17:44 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:17:44 user nova-compute[74880]:   </features>
Nov 15 01:17:44 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:17:44 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:17:44 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:17:44 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:17:44 user nova-compute[74880]:   </clock>
Nov 15 01:17:44 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:17:44 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:17:44 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:17:44 user nova-compute[74880]:   </cpu>
Nov 15 01:17:44 user nova-compute[74880]:   <devices>
Nov 15 01:17:44 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:17:44 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:17:44 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk"/>
Nov 15 01:17:44 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:17:44 user nova-compute[74880]:     </disk>
Nov 15 01:17:44 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:17:44 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:17:44 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:17:44 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:17:44 user nova-compute[74880]:       <serial>88a0212f-eae8-4d8b-adfa-bde57ca00e4e</serial>
Nov 15 01:17:44 user nova-compute[74880]:     </disk>
Nov 15 01:17:44 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:17:44 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:17:44 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue"/>
Nov 15 01:17:44 user nova-compute[74880]:       <target dev="vdc" bus="virtio"/>
Nov 15 01:17:44 user nova-compute[74880]:       <boot order="1"/>
Nov 15 01:17:44 user nova-compute[74880]:     </disk>
Nov 15 01:17:44 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:17:44 user nova-compute[74880]:       <mac address="fa:16:3e:33:94:c9"/>
Nov 15 01:17:44 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:17:44 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:17:44 user nova-compute[74880]:       <target dev="tap9328a08d-3d"/>
Nov 15 01:17:44 user nova-compute[74880]:     </interface>
Nov 15 01:17:44 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:17:44 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/console.log" append="off"/>
Nov 15 01:17:44 user nova-compute[74880]:     </serial>
Nov 15 01:17:44 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:17:44 user nova-compute[74880]:     <video>
Nov 15 01:17:44 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:17:44 user nova-compute[74880]:     </video>
Nov 15 01:17:44 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:17:44 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:17:44 user nova-compute[74880]:     </rng>
Nov 15 01:17:44 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:17:44 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:17:44 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:17:44 user nova-compute[74880]:     </memballoon>
Nov 15 01:17:44 user nova-compute[74880]:   </devices>
Nov 15 01:17:44 user nova-compute[74880]: </domain>
Nov 15 01:17:44 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:17:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance destroyed successfully.
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] No VIF found with MAC fa:16:3e:33:94:c9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:17:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:46 user nova-compute[74880]: INFO nova.compute.manager [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Detaching volume b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:17:46 user nova-compute[74880]: INFO nova.virt.block_device [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Attempting to driver detach volume b85f66b3-5491-4dad-917b-d00b210f6a57 from mountpoint /dev/vdb
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Attempting to detach device vdb from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:17:46 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:17:46 user nova-compute[74880]:   <source dev="/dev/sdi"/>
Nov 15 01:17:46 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:17:46 user nova-compute[74880]:   <serial>b85f66b3-5491-4dad-917b-d00b210f6a57</serial>
Nov 15 01:17:46 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:17:46 user nova-compute[74880]: </disk>
Nov 15 01:17:46 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:17:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Successfully detached device vdb from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the persistent domain config.
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:17:46 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:17:46 user nova-compute[74880]:   <source dev="/dev/sdi"/>
Nov 15 01:17:46 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:17:46 user nova-compute[74880]:   <serial>b85f66b3-5491-4dad-917b-d00b210f6a57</serial>
Nov 15 01:17:46 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:17:46 user nova-compute[74880]: </disk>
Nov 15 01:17:46 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-8443754d-fd67-4a81-af19-8ef14a98629f req-809e7bcf-bc13-43a2-9716-eb71261914b7 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8443754d-fd67-4a81-af19-8ef14a98629f req-809e7bcf-bc13-43a2-9716-eb71261914b7 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8443754d-fd67-4a81-af19-8ef14a98629f req-809e7bcf-bc13-43a2-9716-eb71261914b7 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8443754d-fd67-4a81-af19-8ef14a98629f req-809e7bcf-bc13-43a2-9716-eb71261914b7 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-8443754d-fd67-4a81-af19-8ef14a98629f req-809e7bcf-bc13-43a2-9716-eb71261914b7 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:46 user nova-compute[74880]: WARNING nova.compute.manager [req-8443754d-fd67-4a81-af19-8ef14a98629f req-809e7bcf-bc13-43a2-9716-eb71261914b7 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state active and task_state rescuing.
Nov 15 01:17:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b7c42e47-6d63-42aa-91be-64f988742804 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-a0bd07e4-bc28-4d6b-ab91-7a6841e0c632 req-2eaa087b-6216-450f-9486-d509c9cae77f service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0bd07e4-bc28-4d6b-ab91-7a6841e0c632 req-2eaa087b-6216-450f-9486-d509c9cae77f service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0bd07e4-bc28-4d6b-ab91-7a6841e0c632 req-2eaa087b-6216-450f-9486-d509c9cae77f service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0bd07e4-bc28-4d6b-ab91-7a6841e0c632 req-2eaa087b-6216-450f-9486-d509c9cae77f service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-a0bd07e4-bc28-4d6b-ab91-7a6841e0c632 req-2eaa087b-6216-450f-9486-d509c9cae77f service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:48 user nova-compute[74880]: WARNING nova.compute.manager [req-a0bd07e4-bc28-4d6b-ab91-7a6841e0c632 req-2eaa087b-6216-450f-9486-d509c9cae77f service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state rescued and task_state None.
Nov 15 01:17:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:17:48 user nova-compute[74880]: INFO nova.compute.claims [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Claim successful on node user
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:17:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.policy [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a155f47f27764edc928e03eb206878a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5c5912c3d64b998e5d3f72f9fe7ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:17:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Creating image(s)
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "/opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "/opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "/opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.213s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk 1073741824" returned: 0 in 0.068s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Successfully created port: 5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.238s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Cannot resize image /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Ensure instance console log exists: /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Successfully updated port: 5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "refresh_cache-d01b6d80-bc59-4981-90a8-a5bd663ae46b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquired lock "refresh_cache-d01b6d80-bc59-4981-90a8-a5bd663ae46b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-changed-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Refreshing instance network info cache due to event network-changed-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] Acquiring lock "refresh_cache-d01b6d80-bc59-4981-90a8-a5bd663ae46b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Updating instance_info_cache with network_info: [{"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Releasing lock "refresh_cache-d01b6d80-bc59-4981-90a8-a5bd663ae46b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Instance network_info: |[{"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] Acquired lock "refresh_cache-d01b6d80-bc59-4981-90a8-a5bd663ae46b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.neutron [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Refreshing network info cache for port 5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Start _get_guest_xml network_info=[{"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:17:51 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:51 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1582890006',display_name='tempest-DeleteServersTestJSON-server-1582890006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1582890006',id=16,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d5c5912c3d64b998e5d3f72f9fe7ee0',ramdisk_id='',reservation_id='r-jm2hankh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1683354336',owner_user_name='tempest-DeleteServersTestJSON-1683354336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:17:50Z,user_data=None,user_id='a155f47f27764edc928e03eb206878a8',uuid=d01b6d80-bc59-4981-90a8-a5bd663ae46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Converting VIF {"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lazy-loading 'pci_devices' on Instance uuid d01b6d80-bc59-4981-90a8-a5bd663ae46b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:17:51 user nova-compute[74880]:   <uuid>d01b6d80-bc59-4981-90a8-a5bd663ae46b</uuid>
Nov 15 01:17:51 user nova-compute[74880]:   <name>instance-00000010</name>
Nov 15 01:17:51 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:17:51 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:17:51 user nova-compute[74880]:   <metadata>
Nov 15 01:17:51 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:17:51 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:17:51 user nova-compute[74880]:       <nova:name>tempest-DeleteServersTestJSON-server-1582890006</nova:name>
Nov 15 01:17:51 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:17:51</nova:creationTime>
Nov 15 01:17:51 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:17:51 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:17:51 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:17:51 user nova-compute[74880]:       <nova:owner>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:user uuid="a155f47f27764edc928e03eb206878a8">tempest-DeleteServersTestJSON-1683354336-project-member</nova:user>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:project uuid="4d5c5912c3d64b998e5d3f72f9fe7ee0">tempest-DeleteServersTestJSON-1683354336</nova:project>
Nov 15 01:17:51 user nova-compute[74880]:       </nova:owner>
Nov 15 01:17:51 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:17:51 user nova-compute[74880]:       <nova:ports>
Nov 15 01:17:51 user nova-compute[74880]:         <nova:port uuid="5d9d04f9-13bb-438f-9fde-afc06ee6dbc2">
Nov 15 01:17:51 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 01:17:51 user nova-compute[74880]:         </nova:port>
Nov 15 01:17:51 user nova-compute[74880]:       </nova:ports>
Nov 15 01:17:51 user nova-compute[74880]:     </nova:instance>
Nov 15 01:17:51 user nova-compute[74880]:   </metadata>
Nov 15 01:17:51 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:17:51 user nova-compute[74880]:     <system>
Nov 15 01:17:51 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:17:51 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:17:51 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:17:51 user nova-compute[74880]:       <entry name="serial">d01b6d80-bc59-4981-90a8-a5bd663ae46b</entry>
Nov 15 01:17:51 user nova-compute[74880]:       <entry name="uuid">d01b6d80-bc59-4981-90a8-a5bd663ae46b</entry>
Nov 15 01:17:51 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:17:51 user nova-compute[74880]:     </system>
Nov 15 01:17:51 user nova-compute[74880]:   </sysinfo>
Nov 15 01:17:51 user nova-compute[74880]:   <os>
Nov 15 01:17:51 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:17:51 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:17:51 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:17:51 user nova-compute[74880]:   </os>
Nov 15 01:17:51 user nova-compute[74880]:   <features>
Nov 15 01:17:51 user nova-compute[74880]:     <acpi/>
Nov 15 01:17:51 user nova-compute[74880]:     <apic/>
Nov 15 01:17:51 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:17:51 user nova-compute[74880]:   </features>
Nov 15 01:17:51 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:17:51 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:17:51 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:17:51 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:17:51 user nova-compute[74880]:   </clock>
Nov 15 01:17:51 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:17:51 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:17:51 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:17:51 user nova-compute[74880]:   </cpu>
Nov 15 01:17:51 user nova-compute[74880]:   <devices>
Nov 15 01:17:51 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:17:51 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:17:51 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk"/>
Nov 15 01:17:51 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:17:51 user nova-compute[74880]:     </disk>
Nov 15 01:17:51 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:17:51 user nova-compute[74880]:       <mac address="fa:16:3e:40:8b:9f"/>
Nov 15 01:17:51 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:17:51 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:17:51 user nova-compute[74880]:       <target dev="tap5d9d04f9-13"/>
Nov 15 01:17:51 user nova-compute[74880]:     </interface>
Nov 15 01:17:51 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:17:51 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/console.log" append="off"/>
Nov 15 01:17:51 user nova-compute[74880]:     </serial>
Nov 15 01:17:51 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:17:51 user nova-compute[74880]:     <video>
Nov 15 01:17:51 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:17:51 user nova-compute[74880]:     </video>
Nov 15 01:17:51 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:17:51 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:17:51 user nova-compute[74880]:     </rng>
Nov 15 01:17:51 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:17:51 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:17:51 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:17:51 user nova-compute[74880]:     </memballoon>
Nov 15 01:17:51 user nova-compute[74880]:   </devices>
Nov 15 01:17:51 user nova-compute[74880]: </domain>
Nov 15 01:17:51 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1582890006',display_name='tempest-DeleteServersTestJSON-server-1582890006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1582890006',id=16,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d5c5912c3d64b998e5d3f72f9fe7ee0',ramdisk_id='',reservation_id='r-jm2hankh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1683354336',owner_user_name='tempest-DeleteServersTestJSON-1683354336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:17:50Z,user_data=None,user_id='a155f47f27764edc928e03eb206878a8',uuid=d01b6d80-bc59-4981-90a8-a5bd663ae46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Converting VIF {"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG os_vif [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85c8822b-cea7-5124-94b7-59268a126c80', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d9d04f9-13, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d9d04f9-13, col_values=(('qos', UUID('3181c1e6-a79d-426d-85e2-b36ef9caa6b7')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d9d04f9-13, col_values=(('external_ids', {'iface-id': '5d9d04f9-13bb-438f-9fde-afc06ee6dbc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:8b:9f', 'vm-uuid': 'd01b6d80-bc59-4981-90a8-a5bd663ae46b'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:17:52 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:52 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.528724670410156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:52 user nova-compute[74880]: INFO os_vif [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13')
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] No VIF found with MAC fa:16:3e:40:8b:9f, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance bc155ceb-d7ca-477b-8479-a459fa50af05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 026890b4-5a76-4730-bc20-54b95359bdcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ffcf53-7fc2-4394-817c-a14ba034d805 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d01b6d80-bc59-4981-90a8-a5bd663ae46b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Updated VIF entry in instance network info cache for port 5d9d04f9-13bb-438f-9fde-afc06ee6dbc2. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Updating instance_info_cache with network_info: [{"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3e38a804-29c6-417e-a139-261143e298e0 req-d33ca234-bbae-4a18-91a1-ec8085f263f1 service nova] Releasing lock "refresh_cache-d01b6d80-bc59-4981-90a8-a5bd663ae46b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:17:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-6e5f9912-220b-46b0-a54d-e2921b159a98 req-1177fdbe-806a-481e-b0b5-5417a7be4100 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6e5f9912-220b-46b0-a54d-e2921b159a98 req-1177fdbe-806a-481e-b0b5-5417a7be4100 service nova] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6e5f9912-220b-46b0-a54d-e2921b159a98 req-1177fdbe-806a-481e-b0b5-5417a7be4100 service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6e5f9912-220b-46b0-a54d-e2921b159a98 req-1177fdbe-806a-481e-b0b5-5417a7be4100 service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-6e5f9912-220b-46b0-a54d-e2921b159a98 req-1177fdbe-806a-481e-b0b5-5417a7be4100 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] No waiting events found dispatching network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:54 user nova-compute[74880]: WARNING nova.compute.manager [req-6e5f9912-220b-46b0-a54d-e2921b159a98 req-1177fdbe-806a-481e-b0b5-5417a7be4100 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received unexpected event network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 for instance with vm_state building and task_state spawning.
Nov 15 01:17:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:17:56 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Instance spawned successfully.
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-df17e24e-a750-4419-9086-ad9478071424 req-74157039-e01f-43b7-ae02-4d5340ac4c4e service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-df17e24e-a750-4419-9086-ad9478071424 req-74157039-e01f-43b7-ae02-4d5340ac4c4e service nova] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-df17e24e-a750-4419-9086-ad9478071424 req-74157039-e01f-43b7-ae02-4d5340ac4c4e service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-df17e24e-a750-4419-9086-ad9478071424 req-74157039-e01f-43b7-ae02-4d5340ac4c4e service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-df17e24e-a750-4419-9086-ad9478071424 req-74157039-e01f-43b7-ae02-4d5340ac4c4e service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] No waiting events found dispatching network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:17:56 user nova-compute[74880]: WARNING nova.compute.manager [req-df17e24e-a750-4419-9086-ad9478071424 req-74157039-e01f-43b7-ae02-4d5340ac4c4e service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received unexpected event network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 for instance with vm_state building and task_state spawning.
Nov 15 01:17:56 user nova-compute[74880]: INFO nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 15 01:17:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:17:56 user nova-compute[74880]: INFO nova.compute.manager [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Took 7.44 seconds to build instance.
Nov 15 01:17:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2cf2533-fc58-4042-84f3-02d6f1a6af5c tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.569s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:17:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:17:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:18:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:03 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:18:03 user nova-compute[74880]: INFO nova.compute.claims [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Claim successful on node user
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:18:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.policy [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baa7a9a3c7994818bee910e2bf0e6043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b855ee7bc0e344ac836b02b1e86c3798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:18:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Creating image(s)
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk 1073741824" returned: 0 in 0.051s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.network.neutron [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Successfully created port: 6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Cannot resize image /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Ensure instance console log exists: /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.network.neutron [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Successfully updated port: 6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.network.neutron [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-changed-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Refreshing instance network info cache due to event network-changed-6fe814ba-5ec3-4038-9d2e-694980cd4ed3. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:18:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance network_info: |[{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Refreshing network info cache for port 6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start _get_guest_xml network_info=[{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:18:06 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:06 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.objects.instance [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'pci_devices' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:18:06 user nova-compute[74880]:   <uuid>00eda474-3fbc-45ce-8986-6e8cbb90bd2d</uuid>
Nov 15 01:18:06 user nova-compute[74880]:   <name>instance-00000011</name>
Nov 15 01:18:06 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:18:06 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:18:06 user nova-compute[74880]:   <metadata>
Nov 15 01:18:06 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:18:06 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:18:06 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherB-server-1351279143</nova:name>
Nov 15 01:18:06 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:18:06</nova:creationTime>
Nov 15 01:18:06 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:18:06 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:18:06 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:18:06 user nova-compute[74880]:       <nova:owner>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:user uuid="baa7a9a3c7994818bee910e2bf0e6043">tempest-ServerActionsTestOtherB-230839994-project-member</nova:user>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:project uuid="b855ee7bc0e344ac836b02b1e86c3798">tempest-ServerActionsTestOtherB-230839994</nova:project>
Nov 15 01:18:06 user nova-compute[74880]:       </nova:owner>
Nov 15 01:18:06 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:18:06 user nova-compute[74880]:       <nova:ports>
Nov 15 01:18:06 user nova-compute[74880]:         <nova:port uuid="6fe814ba-5ec3-4038-9d2e-694980cd4ed3">
Nov 15 01:18:06 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:18:06 user nova-compute[74880]:         </nova:port>
Nov 15 01:18:06 user nova-compute[74880]:       </nova:ports>
Nov 15 01:18:06 user nova-compute[74880]:     </nova:instance>
Nov 15 01:18:06 user nova-compute[74880]:   </metadata>
Nov 15 01:18:06 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:18:06 user nova-compute[74880]:     <system>
Nov 15 01:18:06 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:18:06 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:18:06 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:18:06 user nova-compute[74880]:       <entry name="serial">00eda474-3fbc-45ce-8986-6e8cbb90bd2d</entry>
Nov 15 01:18:06 user nova-compute[74880]:       <entry name="uuid">00eda474-3fbc-45ce-8986-6e8cbb90bd2d</entry>
Nov 15 01:18:06 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:18:06 user nova-compute[74880]:     </system>
Nov 15 01:18:06 user nova-compute[74880]:   </sysinfo>
Nov 15 01:18:06 user nova-compute[74880]:   <os>
Nov 15 01:18:06 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:18:06 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:18:06 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:18:06 user nova-compute[74880]:   </os>
Nov 15 01:18:06 user nova-compute[74880]:   <features>
Nov 15 01:18:06 user nova-compute[74880]:     <acpi/>
Nov 15 01:18:06 user nova-compute[74880]:     <apic/>
Nov 15 01:18:06 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:18:06 user nova-compute[74880]:   </features>
Nov 15 01:18:06 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:18:06 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:18:06 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:18:06 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:18:06 user nova-compute[74880]:   </clock>
Nov 15 01:18:06 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:18:06 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:18:06 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:18:06 user nova-compute[74880]:   </cpu>
Nov 15 01:18:06 user nova-compute[74880]:   <devices>
Nov 15 01:18:06 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:18:06 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:18:06 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk"/>
Nov 15 01:18:06 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:18:06 user nova-compute[74880]:     </disk>
Nov 15 01:18:06 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:18:06 user nova-compute[74880]:       <mac address="fa:16:3e:0f:db:87"/>
Nov 15 01:18:06 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:18:06 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:18:06 user nova-compute[74880]:       <target dev="tap6fe814ba-5e"/>
Nov 15 01:18:06 user nova-compute[74880]:     </interface>
Nov 15 01:18:06 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:18:06 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/console.log" append="off"/>
Nov 15 01:18:06 user nova-compute[74880]:     </serial>
Nov 15 01:18:06 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:18:06 user nova-compute[74880]:     <video>
Nov 15 01:18:06 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:18:06 user nova-compute[74880]:     </video>
Nov 15 01:18:06 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:18:06 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:18:06 user nova-compute[74880]:     </rng>
Nov 15 01:18:06 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:18:06 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:18:06 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:18:06 user nova-compute[74880]:     </memballoon>
Nov 15 01:18:06 user nova-compute[74880]:   </devices>
Nov 15 01:18:06 user nova-compute[74880]: </domain>
Nov 15 01:18:06 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_vif [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bece979d-ffd4-57dd-99bd-cdc91472098b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fe814ba-5e, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fe814ba-5e, col_values=(('qos', UUID('9e44ed7d-4c0f-44ca-bf04-668c9e57e3be')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fe814ba-5e, col_values=(('external_ids', {'iface-id': '6fe814ba-5ec3-4038-9d2e-694980cd4ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:db:87', 'vm-uuid': '00eda474-3fbc-45ce-8986-6e8cbb90bd2d'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: INFO os_vif [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e')
Nov 15 01:18:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No VIF found with MAC fa:16:3e:0f:db:87, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:18:06 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 026890b4-5a76-4730-bc20-54b95359bdcc is timed out.
Nov 15 01:18:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Successfully detached device vdb from instance 026890b4-5a76-4730-bc20-54b95359bdcc from the live domain config.
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwakyhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:18:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f0f183-d7b3-4eff-932b-31506e42607b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:18:06 user nova-compute[74880]: No targets found.
Nov 15 01:18:06 user nova-compute[74880]: iSNS:
Nov 15 01:18:06 user nova-compute[74880]: No targets found.
Nov 15 01:18:06 user nova-compute[74880]: STATIC:
Nov 15 01:18:06 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:18:06 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:18:06 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:18:06 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57
Nov 15 01:18:06 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:18:06 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:18:06 user nova-compute[74880]: FIRMWARE:
Nov 15 01:18:06 user nova-compute[74880]: No targets found.
Nov 15 01:18:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:18:06 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:18:06 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7169e3cf-61b2-45c8-9ced-6f8b43a2ac94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e33cb-a971-4b0e-8651-44a1f4ea3eba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:18:06 user nova-compute[74880]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:18:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 (non-flash)
Nov 15 01:18:06 user nova-compute[74880]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:18:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01b5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57'): ({'sdi'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Removing single pathed devices sdi {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc2fca1-5200-49c5-8d98-5371ca208e5f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac16ce-2ded-4be4-86ac-0cea896ea8f7]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Flushing IO for device /dev/sdi {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d919ef-728a-4266-bba0-83cfee53d3fd]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updated VIF entry in instance network info cache for port 6fe814ba-5ec3-4038-9d2e-694980cd4ed3. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e759313-032c-4530-acda-53fc225a2ce2]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] SCSI volumes sdi have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e11a989e-47af-477d-ac39-23563fc2cd50 req-3cb9fd08-af1d-4927-a9f1-8522af199063 service nova] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[083fd914-157d-4d8c-9a02-de0e9bde52bd]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:18:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.154s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e6a83-f96c-4799-947b-ebefdd13919f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260]
Nov 15 01:18:07 user nova-compute[74880]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57, portal: 172.16.0.220,3260] successful.
Nov 15 01:18:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85f66b3-5491-4dad-917b-d00b210f6a57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd8a8ce-2e8f-416f-9d0b-1e7267de826c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] <== disconnect_volume: return (414ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG nova.objects.instance [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'flavor' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-51f20e86-7fa8-497b-8722-59e63989cc16 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.266s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-677b8c46-2c26-44f9-b9c7-b01e079cd0b3 req-bfa36e81-03e3-48f2-b1dc-392294bcc985 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-677b8c46-2c26-44f9-b9c7-b01e079cd0b3 req-bfa36e81-03e3-48f2-b1dc-392294bcc985 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-677b8c46-2c26-44f9-b9c7-b01e079cd0b3 req-bfa36e81-03e3-48f2-b1dc-392294bcc985 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-677b8c46-2c26-44f9-b9c7-b01e079cd0b3 req-bfa36e81-03e3-48f2-b1dc-392294bcc985 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-677b8c46-2c26-44f9-b9c7-b01e079cd0b3 req-bfa36e81-03e3-48f2-b1dc-392294bcc985 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:08 user nova-compute[74880]: WARNING nova.compute.manager [req-677b8c46-2c26-44f9-b9c7-b01e079cd0b3 req-bfa36e81-03e3-48f2-b1dc-392294bcc985 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state building and task_state spawning.
Nov 15 01:18:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:18:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance spawned successfully.
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:10 user nova-compute[74880]: INFO nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:18:10 user nova-compute[74880]: INFO nova.compute.manager [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Took 6.45 seconds to build instance.
Nov 15 01:18:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1c00025a-9867-4a5a-b80d-6b1f42c33969 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.564s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-efc93b6d-36c5-4543-9bb6-2afa2a8a8a64 req-cc602b5a-c749-43eb-aec1-4ba5e4b48efe service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-efc93b6d-36c5-4543-9bb6-2afa2a8a8a64 req-cc602b5a-c749-43eb-aec1-4ba5e4b48efe service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-efc93b6d-36c5-4543-9bb6-2afa2a8a8a64 req-cc602b5a-c749-43eb-aec1-4ba5e4b48efe service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-efc93b6d-36c5-4543-9bb6-2afa2a8a8a64 req-cc602b5a-c749-43eb-aec1-4ba5e4b48efe service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-efc93b6d-36c5-4543-9bb6-2afa2a8a8a64 req-cc602b5a-c749-43eb-aec1-4ba5e4b48efe service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:10 user nova-compute[74880]: WARNING nova.compute.manager [req-efc93b6d-36c5-4543-9bb6-2afa2a8a8a64 req-cc602b5a-c749-43eb-aec1-4ba5e4b48efe service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state active and task_state None.
Nov 15 01:18:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:22 user nova-compute[74880]: INFO nova.compute.manager [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Rescuing
Nov 15 01:18:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:18:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:18:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG nova.network.neutron [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance destroyed successfully.
Nov 15 01:18:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Attempting rescue
Nov 15 01:18:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74880) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:18:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Creating image(s)
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue" returned: 0 in 0.072s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'migration_context' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.base [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Start _get_guest_xml network_info=[{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:ba:aa:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'resources' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.base [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'numa_topology' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.base [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:18:24 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:24 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.base [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1651043979',display_name='tempest-ServerRescueNegativeTestJSON-server-1651043979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1651043979',id=1,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-9rf0n0nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:13:55Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:ba:aa:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:ba:aa:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'pci_devices' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.objects.base [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:18:24 user nova-compute[74880]:   <uuid>67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0</uuid>
Nov 15 01:18:24 user nova-compute[74880]:   <name>instance-00000001</name>
Nov 15 01:18:24 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:18:24 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:18:24 user nova-compute[74880]:   <metadata>
Nov 15 01:18:24 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:18:24 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:18:24 user nova-compute[74880]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1651043979</nova:name>
Nov 15 01:18:24 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:18:24</nova:creationTime>
Nov 15 01:18:24 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:18:24 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:18:24 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:18:24 user nova-compute[74880]:       <nova:owner>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:user uuid="7c88b23d691c4cdc98757d0af8ab27c1">tempest-ServerRescueNegativeTestJSON-1212122190-project-member</nova:user>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:project uuid="d96e59bffc2b4c99940e4c87ad82521e">tempest-ServerRescueNegativeTestJSON-1212122190</nova:project>
Nov 15 01:18:24 user nova-compute[74880]:       </nova:owner>
Nov 15 01:18:24 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:18:24 user nova-compute[74880]:       <nova:ports>
Nov 15 01:18:24 user nova-compute[74880]:         <nova:port uuid="425e2abd-4b97-45d3-bf1d-83aee8ad920d">
Nov 15 01:18:24 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:18:24 user nova-compute[74880]:         </nova:port>
Nov 15 01:18:24 user nova-compute[74880]:       </nova:ports>
Nov 15 01:18:24 user nova-compute[74880]:     </nova:instance>
Nov 15 01:18:24 user nova-compute[74880]:   </metadata>
Nov 15 01:18:24 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:18:24 user nova-compute[74880]:     <system>
Nov 15 01:18:24 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:18:24 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:18:24 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:18:24 user nova-compute[74880]:       <entry name="serial">67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0</entry>
Nov 15 01:18:24 user nova-compute[74880]:       <entry name="uuid">67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0</entry>
Nov 15 01:18:24 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:18:24 user nova-compute[74880]:     </system>
Nov 15 01:18:24 user nova-compute[74880]:   </sysinfo>
Nov 15 01:18:24 user nova-compute[74880]:   <os>
Nov 15 01:18:24 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:18:24 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:18:24 user nova-compute[74880]:   </os>
Nov 15 01:18:24 user nova-compute[74880]:   <features>
Nov 15 01:18:24 user nova-compute[74880]:     <acpi/>
Nov 15 01:18:24 user nova-compute[74880]:     <apic/>
Nov 15 01:18:24 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:18:24 user nova-compute[74880]:   </features>
Nov 15 01:18:24 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:18:24 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:18:24 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:18:24 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:18:24 user nova-compute[74880]:   </clock>
Nov 15 01:18:24 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:18:24 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:18:24 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:18:24 user nova-compute[74880]:   </cpu>
Nov 15 01:18:24 user nova-compute[74880]:   <devices>
Nov 15 01:18:24 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:18:24 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:18:24 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue"/>
Nov 15 01:18:24 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:18:24 user nova-compute[74880]:     </disk>
Nov 15 01:18:24 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:18:24 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:18:24 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk"/>
Nov 15 01:18:24 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:18:24 user nova-compute[74880]:     </disk>
Nov 15 01:18:24 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:18:24 user nova-compute[74880]:       <mac address="fa:16:3e:ba:aa:8e"/>
Nov 15 01:18:24 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:18:24 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:18:24 user nova-compute[74880]:       <target dev="tap425e2abd-4b"/>
Nov 15 01:18:24 user nova-compute[74880]:     </interface>
Nov 15 01:18:24 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:18:24 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/console.log" append="off"/>
Nov 15 01:18:24 user nova-compute[74880]:     </serial>
Nov 15 01:18:24 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:18:24 user nova-compute[74880]:     <video>
Nov 15 01:18:24 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:18:24 user nova-compute[74880]:     </video>
Nov 15 01:18:24 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:18:24 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:18:24 user nova-compute[74880]:     </rng>
Nov 15 01:18:24 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:18:24 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:18:24 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:18:24 user nova-compute[74880]:     </memballoon>
Nov 15 01:18:24 user nova-compute[74880]:   </devices>
Nov 15 01:18:24 user nova-compute[74880]: </domain>
Nov 15 01:18:24 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:18:24 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance destroyed successfully.
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:18:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:ba:aa:8e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:18:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-f49471d1-3737-4d17-ad48-88a2394b1ad8 req-867aa921-ddc4-436d-a465-85dfc0e51d8e service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f49471d1-3737-4d17-ad48-88a2394b1ad8 req-867aa921-ddc4-436d-a465-85dfc0e51d8e service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f49471d1-3737-4d17-ad48-88a2394b1ad8 req-867aa921-ddc4-436d-a465-85dfc0e51d8e service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f49471d1-3737-4d17-ad48-88a2394b1ad8 req-867aa921-ddc4-436d-a465-85dfc0e51d8e service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-f49471d1-3737-4d17-ad48-88a2394b1ad8 req-867aa921-ddc4-436d-a465-85dfc0e51d8e service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:26 user nova-compute[74880]: WARNING nova.compute.manager [req-f49471d1-3737-4d17-ad48-88a2394b1ad8 req-867aa921-ddc4-436d-a465-85dfc0e51d8e service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state active and task_state rescuing.
Nov 15 01:18:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-aa4bd986-9979-4fce-8afc-d0e4f7cdbc65 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:18:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-14af59f5-82c8-406e-9f6d-245d5ab7c52c req-b09018d7-f956-423c-b59b-366a67468062 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-14af59f5-82c8-406e-9f6d-245d5ab7c52c req-b09018d7-f956-423c-b59b-366a67468062 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-14af59f5-82c8-406e-9f6d-245d5ab7c52c req-b09018d7-f956-423c-b59b-366a67468062 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-14af59f5-82c8-406e-9f6d-245d5ab7c52c req-b09018d7-f956-423c-b59b-366a67468062 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-14af59f5-82c8-406e-9f6d-245d5ab7c52c req-b09018d7-f956-423c-b59b-366a67468062 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:28 user nova-compute[74880]: WARNING nova.compute.manager [req-14af59f5-82c8-406e-9f6d-245d5ab7c52c req-b09018d7-f956-423c-b59b-366a67468062 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state None.
Nov 15 01:18:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-f7c5b63b-864e-4834-ae42-a5064fe5e072 req-a1c8bcb0-869b-4e34-aa17-385687eeca47 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f7c5b63b-864e-4834-ae42-a5064fe5e072 req-a1c8bcb0-869b-4e34-aa17-385687eeca47 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f7c5b63b-864e-4834-ae42-a5064fe5e072 req-a1c8bcb0-869b-4e34-aa17-385687eeca47 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f7c5b63b-864e-4834-ae42-a5064fe5e072 req-a1c8bcb0-869b-4e34-aa17-385687eeca47 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-f7c5b63b-864e-4834-ae42-a5064fe5e072 req-a1c8bcb0-869b-4e34-aa17-385687eeca47 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:33 user nova-compute[74880]: WARNING nova.compute.manager [req-f7c5b63b-864e-4834-ae42-a5064fe5e072 req-a1c8bcb0-869b-4e34-aa17-385687eeca47 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state None.
Nov 15 01:18:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-f1557235-9884-4991-a912-43b4cb6e7c79 req-367bb601-e9cb-4d54-afc5-3998a13c7db1 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f1557235-9884-4991-a912-43b4cb6e7c79 req-367bb601-e9cb-4d54-afc5-3998a13c7db1 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f1557235-9884-4991-a912-43b4cb6e7c79 req-367bb601-e9cb-4d54-afc5-3998a13c7db1 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f1557235-9884-4991-a912-43b4cb6e7c79 req-367bb601-e9cb-4d54-afc5-3998a13c7db1 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-f1557235-9884-4991-a912-43b4cb6e7c79 req-367bb601-e9cb-4d54-afc5-3998a13c7db1 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:35 user nova-compute[74880]: WARNING nova.compute.manager [req-f1557235-9884-4991-a912-43b4cb6e7c79 req-367bb601-e9cb-4d54-afc5-3998a13c7db1 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state None.
Nov 15 01:18:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:36 user nova-compute[74880]: INFO nova.compute.manager [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Terminating instance
Nov 15 01:18:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Instance destroyed successfully.
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lazy-loading 'resources' on Instance uuid 026890b4-5a76-4730-bc20-54b95359bdcc {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-122727823',display_name='tempest-TestServerVolumeAttachmentScenario-server-122727823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-122727823',id=10,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUW+qiPFt0RgTyTq/OTay2LTA64jjQB3wMHAF9D5JyPnUUQStlr/2pu+Geil8tHyuFDaNbxaQmNmmMjVumwI/74ADLqxZHJRodDT8jdGrsIHJTwXFh9PxR99fTrNG0CRA==',key_name='tempest-keypair-2095369327',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f88735b9c54ff08003cf50e6672982',ramdisk_id='',reservation_id='r-ixkdepwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-573761567',owner_user_name='tempest-TestServerVolumeAttachmentScenario-573761567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddd620f3b9e94da58eba4c41008b4c44',uuid=026890b4-5a76-4730-bc20-54b95359bdcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Converting VIF {"id": "79379e5f-03d1-42b8-aff4-71297ee3f026", "address": "fa:16:3e:c5:a0:82", "network": {"id": "4afcee8b-112f-4c51-be26-9d4ffd094b95", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1087872199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f88735b9c54ff08003cf50e6672982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79379e5f-03", "ovs_interfaceid": "79379e5f-03d1-42b8-aff4-71297ee3f026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG os_vif [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79379e5f-03, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5fd4c6d-a42b-44e9-a2f7-b1c245a54491) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-unplugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-unplugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-unplugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:37 user nova-compute[74880]: WARNING nova.compute.manager [req-2cded607-b344-4aa3-817c-809e43dadb59 req-50a5f89a-cc08-498f-9665-89af2e755cac service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received unexpected event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with vm_state active and task_state deleting.
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:37 user nova-compute[74880]: INFO os_vif [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a0:82,bridge_name='br-int',has_traffic_filtering=True,id=79379e5f-03d1-42b8-aff4-71297ee3f026,network=Network(4afcee8b-112f-4c51-be26-9d4ffd094b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79379e5f-03')
Nov 15 01:18:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Deleting instance files /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc_del
Nov 15 01:18:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Deletion of /opt/stack/data/nova/instances/026890b4-5a76-4730-bc20-54b95359bdcc_del complete
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: INFO nova.compute.manager [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 01:18:37 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:38 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:38 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Took 0.87 seconds to deallocate network for instance.
Nov 15 01:18:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:38 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:18:38 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:18:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:38 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Deleted allocations for instance 026890b4-5a76-4730-bc20-54b95359bdcc
Nov 15 01:18:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d529efc-6036-4b9a-8b5f-1a1daf0a10c0 tempest-TestServerVolumeAttachmentScenario-573761567 tempest-TestServerVolumeAttachmentScenario-573761567-project-member] Lock "026890b4-5a76-4730-bc20-54b95359bdcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:39 user nova-compute[74880]: WARNING nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received unexpected event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with vm_state deleted and task_state None.
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:39 user nova-compute[74880]: WARNING nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received unexpected event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with vm_state deleted and task_state None.
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-deleted-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Acquiring lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] Lock "026890b4-5a76-4730-bc20-54b95359bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] No waiting events found dispatching network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:39 user nova-compute[74880]: WARNING nova.compute.manager [req-30c657c2-d25b-41ce-b54c-d8a37dadc4b8 req-c33014ca-20bc-4cd9-9812-31c373b9e463 service nova] [instance: 026890b4-5a76-4730-bc20-54b95359bdcc] Received unexpected event network-vif-plugged-79379e5f-03d1-42b8-aff4-71297ee3f026 for instance with vm_state deleted and task_state None.
Nov 15 01:18:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:18:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:40 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:18:40 user nova-compute[74880]: INFO nova.compute.claims [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Claim successful on node user
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:18:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:18:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Creating image(s)
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.policy [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ef2db062fde498e9b86bf3be7a3b3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6bb596d6ac4e4bb4204d711308a832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk 1073741824" returned: 0 in 0.050s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:18:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Cannot resize image /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Ensure instance console log exists: /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG nova.network.neutron [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Successfully created port: 0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:18:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Successfully updated port: 0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquired lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-changed-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Refreshing instance network info cache due to event network-changed-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] Acquiring lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Releasing lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Instance network_info: |[{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] Acquired lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.neutron [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Refreshing network info cache for port 0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Start _get_guest_xml network_info=[{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:18:43 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:43 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'pci_devices' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:18:43 user nova-compute[74880]:   <uuid>46a52acb-8622-452c-824e-66494956c1d9</uuid>
Nov 15 01:18:43 user nova-compute[74880]:   <name>instance-00000012</name>
Nov 15 01:18:43 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:18:43 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:18:43 user nova-compute[74880]:   <metadata>
Nov 15 01:18:43 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:18:43 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:18:43 user nova-compute[74880]:       <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:18:43 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:18:43</nova:creationTime>
Nov 15 01:18:43 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:18:43 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:18:43 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:18:43 user nova-compute[74880]:       <nova:owner>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:18:43 user nova-compute[74880]:       </nova:owner>
Nov 15 01:18:43 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:18:43 user nova-compute[74880]:       <nova:ports>
Nov 15 01:18:43 user nova-compute[74880]:         <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:18:43 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:18:43 user nova-compute[74880]:         </nova:port>
Nov 15 01:18:43 user nova-compute[74880]:       </nova:ports>
Nov 15 01:18:43 user nova-compute[74880]:     </nova:instance>
Nov 15 01:18:43 user nova-compute[74880]:   </metadata>
Nov 15 01:18:43 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:18:43 user nova-compute[74880]:     <system>
Nov 15 01:18:43 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:18:43 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:18:43 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:18:43 user nova-compute[74880]:       <entry name="serial">46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:18:43 user nova-compute[74880]:       <entry name="uuid">46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:18:43 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:18:43 user nova-compute[74880]:     </system>
Nov 15 01:18:43 user nova-compute[74880]:   </sysinfo>
Nov 15 01:18:43 user nova-compute[74880]:   <os>
Nov 15 01:18:43 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:18:43 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:18:43 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:18:43 user nova-compute[74880]:   </os>
Nov 15 01:18:43 user nova-compute[74880]:   <features>
Nov 15 01:18:43 user nova-compute[74880]:     <acpi/>
Nov 15 01:18:43 user nova-compute[74880]:     <apic/>
Nov 15 01:18:43 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:18:43 user nova-compute[74880]:   </features>
Nov 15 01:18:43 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:18:43 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:18:43 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:18:43 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:18:43 user nova-compute[74880]:   </clock>
Nov 15 01:18:43 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:18:43 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:18:43 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:18:43 user nova-compute[74880]:   </cpu>
Nov 15 01:18:43 user nova-compute[74880]:   <devices>
Nov 15 01:18:43 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:18:43 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:18:43 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk"/>
Nov 15 01:18:43 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:18:43 user nova-compute[74880]:     </disk>
Nov 15 01:18:43 user nova-compute[74880]:     <disk type="file" device="cdrom">
Nov 15 01:18:43 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 01:18:43 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config"/>
Nov 15 01:18:43 user nova-compute[74880]:       <target dev="hda" bus="ide"/>
Nov 15 01:18:43 user nova-compute[74880]:     </disk>
Nov 15 01:18:43 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:18:43 user nova-compute[74880]:       <mac address="fa:16:3e:17:e4:55"/>
Nov 15 01:18:43 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:18:43 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:18:43 user nova-compute[74880]:       <target dev="tap0bd9c071-fd"/>
Nov 15 01:18:43 user nova-compute[74880]:     </interface>
Nov 15 01:18:43 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:18:43 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log" append="off"/>
Nov 15 01:18:43 user nova-compute[74880]:     </serial>
Nov 15 01:18:43 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:18:43 user nova-compute[74880]:     <video>
Nov 15 01:18:43 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:18:43 user nova-compute[74880]:     </video>
Nov 15 01:18:43 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:18:43 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:18:43 user nova-compute[74880]:     </rng>
Nov 15 01:18:43 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:18:43 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:18:43 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:18:43 user nova-compute[74880]:     </memballoon>
Nov 15 01:18:43 user nova-compute[74880]:   </devices>
Nov 15 01:18:43 user nova-compute[74880]: </domain>
Nov 15 01:18:43 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG os_vif [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '635c60f7-ad52-530f-9c15-49ad6c545c72', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bd9c071-fd, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bd9c071-fd, col_values=(('qos', UUID('c45fb21a-a868-45f3-af52-deee8a8175cc')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bd9c071-fd, col_values=(('external_ids', {'iface-id': '0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:e4:55', 'vm-uuid': '46a52acb-8622-452c-824e-66494956c1d9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:43 user nova-compute[74880]: INFO os_vif [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd')
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No BDM found with device name hda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:18:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No VIF found with MAC fa:16:3e:17:e4:55, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:18:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Using config drive
Nov 15 01:18:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Creating config drive at /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config
Nov 15 01:18:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptnr330az {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptnr330az" returned: 0 in 0.053s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:44 user nova-compute[74880]: DEBUG nova.network.neutron [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updated VIF entry in instance network info cache for port 0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:18:44 user nova-compute[74880]: DEBUG nova.network.neutron [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8680bb60-f759-4c84-b45f-c4fe7491304e req-028cced2-9be9-45d6-a371-cffa857acd7b service nova] Releasing lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:45 user nova-compute[74880]: INFO nova.compute.manager [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Terminating instance
Nov 15 01:18:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-56f6fc3f-d5ae-421f-b2b9-d1392832e3f1 req-3753d868-5a29-41de-9ea3-46b4fcb767cf service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-56f6fc3f-d5ae-421f-b2b9-d1392832e3f1 req-3753d868-5a29-41de-9ea3-46b4fcb767cf service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-56f6fc3f-d5ae-421f-b2b9-d1392832e3f1 req-3753d868-5a29-41de-9ea3-46b4fcb767cf service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-56f6fc3f-d5ae-421f-b2b9-d1392832e3f1 req-3753d868-5a29-41de-9ea3-46b4fcb767cf service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-56f6fc3f-d5ae-421f-b2b9-d1392832e3f1 req-3753d868-5a29-41de-9ea3-46b4fcb767cf service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:45 user nova-compute[74880]: WARNING nova.compute.manager [req-56f6fc3f-d5ae-421f-b2b9-d1392832e3f1 req-3753d868-5a29-41de-9ea3-46b4fcb767cf service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 for instance with vm_state building and task_state spawning.
Nov 15 01:18:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-2bda6735-d8d8-4b85-a38d-299353887d04 req-3ca5df66-4ef8-4150-877a-3890160a53cf service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-vif-unplugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2bda6735-d8d8-4b85-a38d-299353887d04 req-3ca5df66-4ef8-4150-877a-3890160a53cf service nova] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2bda6735-d8d8-4b85-a38d-299353887d04 req-3ca5df66-4ef8-4150-877a-3890160a53cf service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2bda6735-d8d8-4b85-a38d-299353887d04 req-3ca5df66-4ef8-4150-877a-3890160a53cf service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-2bda6735-d8d8-4b85-a38d-299353887d04 req-3ca5df66-4ef8-4150-877a-3890160a53cf service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] No waiting events found dispatching network-vif-unplugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-2bda6735-d8d8-4b85-a38d-299353887d04 req-3ca5df66-4ef8-4150-877a-3890160a53cf service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-vif-unplugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Instance destroyed successfully.
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'resources' on Instance uuid 11ffcf53-7fc2-4394-817c-a14ba034d805 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-830860037',display_name='tempest-VolumesAdminNegativeTest-server-830860037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-830860037',id=14,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:16:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb9de312532d4574b08130fdcecdaed2',ramdisk_id='',reservation_id='r-pn0js0j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-325468300',owner_user_name='tempest-VolumesAdminNegativeTest-325468300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:16:59Z,user_data=None,user_id='54a257f03d0141539db26a7068a9abf9',uuid=11ffcf53-7fc2-4394-817c-a14ba034d805,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converting VIF {"id": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "address": "fa:16:3e:ae:f5:5b", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa2ab6c-47", "ovs_interfaceid": "6aa2ab6c-47f0-44cb-a968-4632ac81e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG os_vif [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aa2ab6c-47, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=054b2925-591c-48c7-9e6c-6a0112f12eb1) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:18:46 user nova-compute[74880]: INFO os_vif [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f5:5b,bridge_name='br-int',has_traffic_filtering=True,id=6aa2ab6c-47f0-44cb-a968-4632ac81e766,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa2ab6c-47')
Nov 15 01:18:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Deleting instance files /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805_del
Nov 15 01:18:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Deletion of /opt/stack/data/nova/instances/11ffcf53-7fc2-4394-817c-a14ba034d805_del complete
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:46 user nova-compute[74880]: INFO nova.compute.manager [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 01:18:46 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:18:46 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:46 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Took 0.49 seconds to deallocate network for instance.
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-04c59019-b438-44c8-9ace-e93c59da483a req-76a313ae-89c8-418e-b63e-c35cc18925d3 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-vif-deleted-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:47 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Deleted allocations for instance 11ffcf53-7fc2-4394-817c-a14ba034d805
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5d42d5d-6ae8-4207-828f-8f22c958792f tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:18:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Instance spawned successfully.
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-2095396a-85e1-48b0-baa6-7e9efc1a3cd7 req-81db0670-f72e-48cc-abd2-bef0a12ce32e service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2095396a-85e1-48b0-baa6-7e9efc1a3cd7 req-81db0670-f72e-48cc-abd2-bef0a12ce32e service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2095396a-85e1-48b0-baa6-7e9efc1a3cd7 req-81db0670-f72e-48cc-abd2-bef0a12ce32e service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2095396a-85e1-48b0-baa6-7e9efc1a3cd7 req-81db0670-f72e-48cc-abd2-bef0a12ce32e service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-2095396a-85e1-48b0-baa6-7e9efc1a3cd7 req-81db0670-f72e-48cc-abd2-bef0a12ce32e service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:47 user nova-compute[74880]: WARNING nova.compute.manager [req-2095396a-85e1-48b0-baa6-7e9efc1a3cd7 req-81db0670-f72e-48cc-abd2-bef0a12ce32e service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 for instance with vm_state building and task_state spawning.
Nov 15 01:18:47 user nova-compute[74880]: INFO nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 15 01:18:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:18:47 user nova-compute[74880]: INFO nova.compute.manager [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Took 7.36 seconds to build instance.
Nov 15 01:18:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-806589fd-1407-4600-848c-6ba9ca43e661 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-7778826e-6342-4c23-a9a3-9b20ce6864b9 req-bb65361b-4182-47ba-90ad-dc6271da4873 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received event network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:18:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7778826e-6342-4c23-a9a3-9b20ce6864b9 req-bb65361b-4182-47ba-90ad-dc6271da4873 service nova] Acquiring lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7778826e-6342-4c23-a9a3-9b20ce6864b9 req-bb65361b-4182-47ba-90ad-dc6271da4873 service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7778826e-6342-4c23-a9a3-9b20ce6864b9 req-bb65361b-4182-47ba-90ad-dc6271da4873 service nova] Lock "11ffcf53-7fc2-4394-817c-a14ba034d805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-7778826e-6342-4c23-a9a3-9b20ce6864b9 req-bb65361b-4182-47ba-90ad-dc6271da4873 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] No waiting events found dispatching network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:18:48 user nova-compute[74880]: WARNING nova.compute.manager [req-7778826e-6342-4c23-a9a3-9b20ce6864b9 req-bb65361b-4182-47ba-90ad-dc6271da4873 service nova] [instance: 11ffcf53-7fc2-4394-817c-a14ba034d805] Received unexpected event network-vif-plugged-6aa2ab6c-47f0-44cb-a968-4632ac81e766 for instance with vm_state deleted and task_state None.
Nov 15 01:18:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:18:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:18:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:18:59 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:59 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=25.479217529296875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance bc155ceb-d7ca-477b-8479-a459fa50af05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d01b6d80-bc59-4981-90a8-a5bd663ae46b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 46a52acb-8622-452c-824e-66494956c1d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:18:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-changed-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Refreshing instance network info cache due to event network-changed-b42a9438-2c45-46c5-8a25-f0afc867d4bb. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:19:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] Acquiring lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] Acquired lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:26 user nova-compute[74880]: DEBUG nova.network.neutron [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Refreshing network info cache for port b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG nova.objects.instance [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'flavor' on Instance uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updated VIF entry in instance network info cache for port b42a9438-2c45-46c5-8a25-f0afc867d4bb. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updating instance_info_cache with network_info: [{"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-db4d8e46-2781-40a6-872e-8010dba33b30 req-2c5a212b-36b5-4174-95f9-12869c9c713c service nova] Releasing lock "refresh_cache-2a7118ff-95dc-4cf1-a892-5ab701a1600e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:27 user nova-compute[74880]: INFO nova.compute.manager [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attaching volume 7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 to /dev/vdb
Nov 15 01:19:27 user nova-compute[74880]: DEBUG os_brick.utils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4b169-ea13-4e33-821d-9ef62c505b1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ccb19d-ad0e-4440-9183-f8227d918e4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6451c-771f-407e-8e60-f8f13814a3cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e42d6d-77a7-4228-99a3-ec0f0b5a3612]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:19:27 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:19:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d62ab-bb06-45d0-85dc-d5f2a6921022]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG os_brick.utils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:27 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updating existing volume attachment record: b4aa49e4-a5f6-40aa-b719-dcd4137761ae {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:31 user nova-compute[74880]: INFO nova.compute.manager [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Unrescuing
Nov 15 01:19:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'flavor' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-6543960e-e526-4f3a-9bc8-e7083b641e66 req-ce021d94-6f8e-45f1-913a-9dc71d539982 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6543960e-e526-4f3a-9bc8-e7083b641e66 req-ce021d94-6f8e-45f1-913a-9dc71d539982 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6543960e-e526-4f3a-9bc8-e7083b641e66 req-ce021d94-6f8e-45f1-913a-9dc71d539982 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6543960e-e526-4f3a-9bc8-e7083b641e66 req-ce021d94-6f8e-45f1-913a-9dc71d539982 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-6543960e-e526-4f3a-9bc8-e7083b641e66 req-ce021d94-6f8e-45f1-913a-9dc71d539982 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:32 user nova-compute[74880]: WARNING nova.compute.manager [req-6543960e-e526-4f3a-9bc8-e7083b641e66 req-ce021d94-6f8e-45f1-913a-9dc71d539982 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:19:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:32 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:32 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:32 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f34db3-5c6b-4b40-b581-c16fb22da02f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:19:32 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd1168b-c56c-4422-b586-c42b1fe325c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12] added
Nov 15 01:19:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[47de1875-8152-4692-a938-f8a8177eb5af]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance destroyed successfully.
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0930c5a5-6c61-431b-b7fe-73741f24a414]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaSJHFgU {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaSJHFgU" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[03288841-56a7-4fcb-95e6-f4517bf78500]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eaSJHFgU'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[14162d3c-442b-46bf-b200-96482aeab431]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99248ecb-20be-4009-9277-5bb038e675de]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[179024bd-7619-4950-bd86-00810ea158b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]
Nov 15 01:19:32 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.
Nov 15 01:19:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce6948a-27d7-4545-bb54-8fdf5513edcf]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff4e3d5-9ef4-411e-98e7-9cd74fea12ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:32 user nova-compute[74880]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:32 user nova-compute[74880]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.081s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507b9e7-518b-4980-9d3e-24c8879d392f]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:19:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26537623362306462', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537623362306462', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG nova.objects.instance [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'flavor' on Instance uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:19:33 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:19:33 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:19:33 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:19:33 user nova-compute[74880]:   <serial>7582a01c-3ca7-4c69-8ba4-bdd89cac6c12</serial>
Nov 15 01:19:33 user nova-compute[74880]: </disk>
Nov 15 01:19:33 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing instance network info cache due to event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No VIF found with MAC fa:16:3e:52:70:a5, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-590c2ab8-5ad6-4ed9-a306-64eb33f18fca tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.929s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updated VIF entry in instance network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:19:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing instance network info cache due to event network-changed-9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Acquiring lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Acquired lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Refreshing network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updated VIF entry in instance network info cache for port 9328a08d-3dad-4b21-9a7c-94361d28d20b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [{"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Releasing lock "refresh_cache-3afca469-a0b7-4b07-a28a-ead0e367761e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:35 user nova-compute[74880]: WARNING nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:35 user nova-compute[74880]: WARNING nova.compute.manager [req-4c3b726a-7565-4adc-b92e-77c32665fdf7 req-b67da5b2-6561-4918-a393-4cda1c72e50b service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:19:36 user nova-compute[74880]: INFO nova.compute.manager [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Rebuilding instance
Nov 15 01:19:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-92539974-698d-46b0-a8a0-b9cf698a89cf req-4e820f70-a811-4f1b-8f11-da12caca0937 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-92539974-698d-46b0-a8a0-b9cf698a89cf req-4e820f70-a811-4f1b-8f11-da12caca0937 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-92539974-698d-46b0-a8a0-b9cf698a89cf req-4e820f70-a811-4f1b-8f11-da12caca0937 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-92539974-698d-46b0-a8a0-b9cf698a89cf req-4e820f70-a811-4f1b-8f11-da12caca0937 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-92539974-698d-46b0-a8a0-b9cf698a89cf req-4e820f70-a811-4f1b-8f11-da12caca0937 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:36 user nova-compute[74880]: WARNING nova.compute.manager [req-92539974-698d-46b0-a8a0-b9cf698a89cf req-4e820f70-a811-4f1b-8f11-da12caca0937 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:19:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0ba20882-1a96-4520-ab9b-bdce1a61ac22 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-cfcb56d3-8673-4b34-a0c7-f60a0c0ff8f1 req-f50d1670-d50b-443f-9615-ce53852bb662 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-unplugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfcb56d3-8673-4b34-a0c7-f60a0c0ff8f1 req-f50d1670-d50b-443f-9615-ce53852bb662 service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfcb56d3-8673-4b34-a0c7-f60a0c0ff8f1 req-f50d1670-d50b-443f-9615-ce53852bb662 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfcb56d3-8673-4b34-a0c7-f60a0c0ff8f1 req-f50d1670-d50b-443f-9615-ce53852bb662 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-cfcb56d3-8673-4b34-a0c7-f60a0c0ff8f1 req-f50d1670-d50b-443f-9615-ce53852bb662 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-unplugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:36 user nova-compute[74880]: WARNING nova.compute.manager [req-cfcb56d3-8673-4b34-a0c7-f60a0c0ff8f1 req-f50d1670-d50b-443f-9615-ce53852bb662 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-unplugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state active and task_state rebuilding.
Nov 15 01:19:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance destroyed successfully.
Nov 15 01:19:37 user nova-compute[74880]: INFO nova.compute.manager [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Detaching volume 7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:19:37 user nova-compute[74880]: INFO nova.virt.block_device [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attempting to driver detach volume 7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 from mountpoint /dev/vdb
Nov 15 01:19:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Attempting to detach device vdb from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:19:37 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:19:37 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:19:37 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:19:37 user nova-compute[74880]:   <serial>7582a01c-3ca7-4c69-8ba4-bdd89cac6c12</serial>
Nov 15 01:19:37 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:19:37 user nova-compute[74880]: </disk>
Nov 15 01:19:37 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:19:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully detached device vdb from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e from the persistent domain config.
Nov 15 01:19:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:37 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d6e29-663f-4339-afc6-d74c1b51eaff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:19:37 user nova-compute[74880]: No targets found.
Nov 15 01:19:37 user nova-compute[74880]: iSNS:
Nov 15 01:19:37 user nova-compute[74880]: No targets found.
Nov 15 01:19:37 user nova-compute[74880]: STATIC:
Nov 15 01:19:37 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:19:37 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:19:37 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:19:37 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:19:37 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:19:37 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:19:37 user nova-compute[74880]: FIRMWARE:
Nov 15 01:19:37 user nova-compute[74880]: No targets found.
Nov 15 01:19:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:19:37 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:19:37 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f260607-05dc-45a5-b23d-cc2525344aba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[922abde5-1025-4d34-939b-7434906a5f4d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:37 user nova-compute[74880]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:37 user nova-compute[74880]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01b5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdb9c3-0cab-4791-8305-342d0bfc4b56]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a3b67-6090-4118-b82f-3aeb72631b6e]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f941620-40e2-4dd7-a19b-4f73b8353e2c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ce816-ec8c-4f3a-89b8-c0beb49b535f]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c87aa7-8df6-4e29-b7a8-b35523eef10b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a988408-ab13-4f66-b8d4-ca18cece2985]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]
Nov 15 01:19:37 user nova-compute[74880]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.
Nov 15 01:19:37 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96112af-9d41-475b-b9a5-45d2d2556e69]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== disconnect_volume: return (292ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:19:37 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance destroyed successfully.
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344540292',display_name='tempest-ServerActionsTestOtherA-server-1509883287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344540292',id=15,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30jO300DrwUN098zh7bTwkPEW0mV1Sl0lx8TlUkml7xDrjGooFZ46Urb83LosU78QkZtWenFmhVocTMQdNZO5q9PR3uzOnDyYcztQ/xZkcTN/+SDQcR7plYcLy61Q/WQ==',key_name='tempest-keypair-833480284',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-d786i2pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=2a7118ff-95dc-4cf1-a892-5ab701a1600e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb42a9438-2c, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=566eb667-8f7c-423d-9cb0-abeab710b801) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: INFO os_vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c')
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:38 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fd6a9b-66e8-4979-91b0-7611656463f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:19:38 user nova-compute[74880]: No targets found.
Nov 15 01:19:38 user nova-compute[74880]: iSNS:
Nov 15 01:19:38 user nova-compute[74880]: No targets found.
Nov 15 01:19:38 user nova-compute[74880]: STATIC:
Nov 15 01:19:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:19:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:19:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:19:38 user nova-compute[74880]: FIRMWARE:
Nov 15 01:19:38 user nova-compute[74880]: No targets found.
Nov 15 01:19:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:19:38 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:19:38 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fa3c44-5e31-4958-99b8-55f9a700ddb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d35b99-4086-4e6b-8a43-1c2f944a98bd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f013f5b0>, {}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Disconnecting from: [] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== disconnect_volume: return (71ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:19:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Deleting instance files /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e_del
Nov 15 01:19:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Deletion of /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e_del complete
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:38 user nova-compute[74880]: INFO nova.compute.manager [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Terminating instance
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-53a94087-e172-4091-9293-2d0cf7593253 req-1efca485-cba7-4bda-980d-6a060417b760 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53a94087-e172-4091-9293-2d0cf7593253 req-1efca485-cba7-4bda-980d-6a060417b760 service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53a94087-e172-4091-9293-2d0cf7593253 req-1efca485-cba7-4bda-980d-6a060417b760 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53a94087-e172-4091-9293-2d0cf7593253 req-1efca485-cba7-4bda-980d-6a060417b760 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-53a94087-e172-4091-9293-2d0cf7593253 req-1efca485-cba7-4bda-980d-6a060417b760 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:38 user nova-compute[74880]: WARNING nova.compute.manager [req-53a94087-e172-4091-9293-2d0cf7593253 req-1efca485-cba7-4bda-980d-6a060417b760 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state active and task_state rebuilding.
Nov 15 01:19:38 user nova-compute[74880]: INFO nova.virt.block_device [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Booting with volume 7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 at /dev/vdb
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG os_brick.utils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe48cf-b51a-4535-872d-84f2eee67768]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926bc1a-6031-4c7a-b91c-4793190897fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d1dfb1-ee53-464e-ae4b-600c8da09b9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c52ae9-2e6f-4f3d-ac85-62bf62a86947]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:19:39 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92550595-cd22-4c01-a2e7-f663fa1c7b2a]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG os_brick.utils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updating existing volume attachment record: df6e6e5f-44c7-4de1-a5c7-b6f377153215 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-d92db5ce-1afc-46dd-b2fa-9343a4a74999 req-3bc22868-c5e4-44ad-8958-ee744d2aee41 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-vif-unplugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d92db5ce-1afc-46dd-b2fa-9343a4a74999 req-3bc22868-c5e4-44ad-8958-ee744d2aee41 service nova] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d92db5ce-1afc-46dd-b2fa-9343a4a74999 req-3bc22868-c5e4-44ad-8958-ee744d2aee41 service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d92db5ce-1afc-46dd-b2fa-9343a4a74999 req-3bc22868-c5e4-44ad-8958-ee744d2aee41 service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-d92db5ce-1afc-46dd-b2fa-9343a4a74999 req-3bc22868-c5e4-44ad-8958-ee744d2aee41 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] No waiting events found dispatching network-vif-unplugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-d92db5ce-1afc-46dd-b2fa-9343a4a74999 req-3bc22868-c5e4-44ad-8958-ee744d2aee41 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-vif-unplugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Instance destroyed successfully.
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lazy-loading 'resources' on Instance uuid bc155ceb-d7ca-477b-8479-a459fa50af05 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833915328',display_name='tempest-VolumesAdminNegativeTest-server-1833915328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833915328',id=6,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1pmKaEPDfYcZib+sRf+999hXHaR7udZ84EMcM8GJYa33D3xwC0MvSuE8kvbmldX7n4pMrJtaMhtqRNMymBTXBZ/vOtvq6kbv255lGxCXF9AtHmeR6LG+BL4kgNUSD5TQ==',key_name='tempest-keypair-733420488',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:14:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb9de312532d4574b08130fdcecdaed2',ramdisk_id='',reservation_id='r-xt55znsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-325468300',owner_user_name='tempest-VolumesAdminNegativeTest-325468300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54a257f03d0141539db26a7068a9abf9',uuid=bc155ceb-d7ca-477b-8479-a459fa50af05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converting VIF {"id": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "address": "fa:16:3e:e1:8f:93", "network": {"id": "c10a8c10-3d54-42c1-917a-c1ed2ad51383", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-454704550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9de312532d4574b08130fdcecdaed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904ecba4-3c", "ovs_interfaceid": "904ecba4-3cc1-4872-9065-4b8923cdbc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG os_vif [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap904ecba4-3c, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09c91961-01c8-4f2f-a8cd-d246a69e6d6b) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:39 user nova-compute[74880]: INFO os_vif [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:8f:93,bridge_name='br-int',has_traffic_filtering=True,id=904ecba4-3cc1-4872-9065-4b8923cdbc70,network=Network(c10a8c10-3d54-42c1-917a-c1ed2ad51383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904ecba4-3c')
Nov 15 01:19:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Deleting instance files /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05_del
Nov 15 01:19:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Deletion of /opt/stack/data/nova/instances/bc155ceb-d7ca-477b-8479-a459fa50af05_del complete
Nov 15 01:19:39 user nova-compute[74880]: INFO nova.compute.manager [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:19:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:19:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-c5d24a7a-9d09-4642-bbc7-b70a08a4ae83 req-8e0fb1f7-b2c3-488e-bb55-21e13ce87f89 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-vif-deleted-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:41 user nova-compute[74880]: INFO nova.compute.manager [req-c5d24a7a-9d09-4642-bbc7-b70a08a4ae83 req-8e0fb1f7-b2c3-488e-bb55-21e13ce87f89 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Neutron deleted interface 904ecba4-3cc1-4872-9065-4b8923cdbc70; detaching it from the instance and deleting it from the info cache
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-c5d24a7a-9d09-4642-bbc7-b70a08a4ae83 req-8e0fb1f7-b2c3-488e-bb55-21e13ce87f89 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:41 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Took 1.48 seconds to deallocate network for instance.
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-c5d24a7a-9d09-4642-bbc7-b70a08a4ae83 req-8e0fb1f7-b2c3-488e-bb55-21e13ce87f89 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Detach interface failed, port_id=904ecba4-3cc1-4872-9065-4b8923cdbc70, reason: Instance bc155ceb-d7ca-477b-8479-a459fa50af05 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-ade34562-6c10-4ddb-900c-0e6c53dac2e4 req-6f0c1f78-d967-477f-8eb7-eaf562e86534 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received event network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ade34562-6c10-4ddb-900c-0e6c53dac2e4 req-6f0c1f78-d967-477f-8eb7-eaf562e86534 service nova] Acquiring lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ade34562-6c10-4ddb-900c-0e6c53dac2e4 req-6f0c1f78-d967-477f-8eb7-eaf562e86534 service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ade34562-6c10-4ddb-900c-0e6c53dac2e4 req-6f0c1f78-d967-477f-8eb7-eaf562e86534 service nova] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-ade34562-6c10-4ddb-900c-0e6c53dac2e4 req-6f0c1f78-d967-477f-8eb7-eaf562e86534 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] No waiting events found dispatching network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:41 user nova-compute[74880]: WARNING nova.compute.manager [req-ade34562-6c10-4ddb-900c-0e6c53dac2e4 req-6f0c1f78-d967-477f-8eb7-eaf562e86534 service nova] [instance: bc155ceb-d7ca-477b-8479-a459fa50af05] Received unexpected event network-vif-plugged-904ecba4-3cc1-4872-9065-4b8923cdbc70 for instance with vm_state deleted and task_state None.
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lazy-loading 'flavor' on Instance uuid d01b6d80-bc59-4981-90a8-a5bd663ae46b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:41 user nova-compute[74880]: INFO nova.compute.manager [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Attaching volume b61a0ba1-9262-49c9-821d-75e9e255786e to /dev/vdb
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG os_brick.utils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac30110-0663-4d00-adaf-2f35fa432f30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[630df060-92f3-43bb-b20c-d061f226f820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3116edb7-6909-4d49-94ef-c5cae0912d6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde570b-46bb-4f65-a495-20df585d0795]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:19:41 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d52c94-ad0a-4c26-96d9-899286d13ef0]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG os_brick.utils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Updating existing volume attachment record: e95e9517-9f1a-431c-bd7b-219ece69028a {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:41 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.835s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:42 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Deleted allocations for instance bc155ceb-d7ca-477b-8479-a459fa50af05
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7880ad2a-39c5-4153-b135-c9a023259ad4 tempest-VolumesAdminNegativeTest-325468300 tempest-VolumesAdminNegativeTest-325468300-project-member] Lock "bc155ceb-d7ca-477b-8479-a459fa50af05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.519s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:19:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Creating image(s)
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.212s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk 1073741824" returned: 0 in 0.053s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.492s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Cannot resize image /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Ensure instance console log exists: /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Start _get_guest_xml network_info=[{"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a7118ff-95dc-4cf1-a892-5ab701a1600e', 'attached_at': '', 'detached_at': '', 'volume_id': '7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'serial': '7582a01c-3ca7-4c69-8ba4-bdd89cac6c12'}, 'mount_device': '/dev/vdb', 'attachment_id': 'df6e6e5f-44c7-4de1-a5c7-b6f377153215', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:19:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:19:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=25.488441467285156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 01:19:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:45 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:45 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:45 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb6163c-611c-4073-962b-abcdf6ee1529]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:19:45 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181277c-18fc-44bb-9bf2-250148785400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12] added
Nov 15 01:19:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d01b6d80-bc59-4981-90a8-a5bd663ae46b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 46a52acb-8622-452c-824e-66494956c1d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70bb286-a83b-4890-96f5-87c2b2476837]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dce888-9bab-4084-a258-0a0c4b17a309]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaSJHFgU {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaSJHFgU" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d204db58-d2ed-4847-bad4-33c8a9188340]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eaSJHFgU'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8dbb78-9c38-44b6-acb2-364640c3f979]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c289c6-dc4f-4c0d-bf85-7c4f60358c4f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a721a64e-3ccd-42f6-b877-636362e9e4fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]
Nov 15 01:19:46 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.
Nov 15 01:19:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95bff3-a6ba-4093-95f4-e58b9576b057]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17379f4-0dc1-4b3b-8475-3dc27963e99f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:46 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:46 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb21c5b7-7bfa-4498-a23b-41eb0055c52a]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuxWdlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:47 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26537623362306462', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537623362306462', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.034s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:47 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:47 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f028d11-ea33-4418-93df-5f8e21464bda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:19:47 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344540292',display_name='tempest-ServerActionsTestOtherA-server-1509883287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344540292',id=15,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30jO300DrwUN098zh7bTwkPEW0mV1Sl0lx8TlUkml7xDrjGooFZ46Urb83LosU78QkZtWenFmhVocTMQdNZO5q9PR3uzOnDyYcztQ/xZkcTN/+SDQcR7plYcLy61Q/WQ==',key_name='tempest-keypair-833480284',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-d786i2pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=2a7118ff-95dc-4cf1-a892-5ab701a1600e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:19:47 user nova-compute[74880]:   <uuid>2a7118ff-95dc-4cf1-a892-5ab701a1600e</uuid>
Nov 15 01:19:47 user nova-compute[74880]:   <name>instance-0000000f</name>
Nov 15 01:19:47 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:19:47 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:19:47 user nova-compute[74880]:   <metadata>
Nov 15 01:19:47 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:19:47 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:19:47 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherA-server-1509883287</nova:name>
Nov 15 01:19:47 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:19:45</nova:creationTime>
Nov 15 01:19:47 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:19:47 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:19:47 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:19:47 user nova-compute[74880]:       <nova:owner>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:user uuid="c0b04e9fd63942fb9279c26ddeec3acc">tempest-ServerActionsTestOtherA-1659960630-project-member</nova:user>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:project uuid="d3350f1780d5464dae7c3eca61375446">tempest-ServerActionsTestOtherA-1659960630</nova:project>
Nov 15 01:19:47 user nova-compute[74880]:       </nova:owner>
Nov 15 01:19:47 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:19:47 user nova-compute[74880]:       <nova:ports>
Nov 15 01:19:47 user nova-compute[74880]:         <nova:port uuid="b42a9438-2c45-46c5-8a25-f0afc867d4bb">
Nov 15 01:19:47 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:19:47 user nova-compute[74880]:         </nova:port>
Nov 15 01:19:47 user nova-compute[74880]:       </nova:ports>
Nov 15 01:19:47 user nova-compute[74880]:     </nova:instance>
Nov 15 01:19:47 user nova-compute[74880]:   </metadata>
Nov 15 01:19:47 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:19:47 user nova-compute[74880]:     <system>
Nov 15 01:19:47 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:19:47 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:19:47 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:19:47 user nova-compute[74880]:       <entry name="serial">2a7118ff-95dc-4cf1-a892-5ab701a1600e</entry>
Nov 15 01:19:47 user nova-compute[74880]:       <entry name="uuid">2a7118ff-95dc-4cf1-a892-5ab701a1600e</entry>
Nov 15 01:19:47 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:19:47 user nova-compute[74880]:     </system>
Nov 15 01:19:47 user nova-compute[74880]:   </sysinfo>
Nov 15 01:19:47 user nova-compute[74880]:   <os>
Nov 15 01:19:47 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:19:47 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:19:47 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:19:47 user nova-compute[74880]:   </os>
Nov 15 01:19:47 user nova-compute[74880]:   <features>
Nov 15 01:19:47 user nova-compute[74880]:     <acpi/>
Nov 15 01:19:47 user nova-compute[74880]:     <apic/>
Nov 15 01:19:47 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:19:47 user nova-compute[74880]:   </features>
Nov 15 01:19:47 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:19:47 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:19:47 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:19:47 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:19:47 user nova-compute[74880]:   </clock>
Nov 15 01:19:47 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:19:47 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:19:47 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:19:47 user nova-compute[74880]:   </cpu>
Nov 15 01:19:47 user nova-compute[74880]:   <devices>
Nov 15 01:19:47 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:19:47 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:19:47 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk"/>
Nov 15 01:19:47 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:19:47 user nova-compute[74880]:     </disk>
Nov 15 01:19:47 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:19:47 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:19:47 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:19:47 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:19:47 user nova-compute[74880]:       <serial>7582a01c-3ca7-4c69-8ba4-bdd89cac6c12</serial>
Nov 15 01:19:47 user nova-compute[74880]:     </disk>
Nov 15 01:19:47 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:19:47 user nova-compute[74880]:       <mac address="fa:16:3e:52:70:a5"/>
Nov 15 01:19:47 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:19:47 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:19:47 user nova-compute[74880]:       <target dev="tapb42a9438-2c"/>
Nov 15 01:19:47 user nova-compute[74880]:     </interface>
Nov 15 01:19:47 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:19:47 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/console.log" append="off"/>
Nov 15 01:19:47 user nova-compute[74880]:     </serial>
Nov 15 01:19:47 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:19:47 user nova-compute[74880]:     <video>
Nov 15 01:19:47 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:19:47 user nova-compute[74880]:     </video>
Nov 15 01:19:47 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:19:47 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:19:47 user nova-compute[74880]:     </rng>
Nov 15 01:19:47 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:19:47 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:19:47 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:19:47 user nova-compute[74880]:     </memballoon>
Nov 15 01:19:47 user nova-compute[74880]:   </devices>
Nov 15 01:19:47 user nova-compute[74880]: </domain>
Nov 15 01:19:47 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344540292',display_name='tempest-ServerActionsTestOtherA-server-1509883287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344540292',id=15,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30jO300DrwUN098zh7bTwkPEW0mV1Sl0lx8TlUkml7xDrjGooFZ46Urb83LosU78QkZtWenFmhVocTMQdNZO5q9PR3uzOnDyYcztQ/xZkcTN/+SDQcR7plYcLy61Q/WQ==',key_name='tempest-keypair-833480284',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-d786i2pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=2a7118ff-95dc-4cf1-a892-5ab701a1600e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74cdc444-0649-5c01-8c48-fe1dc6ee4164', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb42a9438-2c, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb42a9438-2c, col_values=(('qos', UUID('c501aa0f-0403-48af-a262-a7aa814f6c4e')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb42a9438-2c, col_values=(('external_ids', {'iface-id': 'b42a9438-2c45-46c5-8a25-f0afc867d4bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:70:a5', 'vm-uuid': '2a7118ff-95dc-4cf1-a892-5ab701a1600e'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1e9e4-0579-40dc-8f84-a5c44abe4de8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e] added
Nov 15 01:19:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:47 user nova-compute[74880]: INFO os_vif [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c')
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa83e6ce-a958-4b76-974f-956cfdd6ea47]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cac358-7a7f-408a-a93e-75286f0bc3b1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmuxWdlD {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No VIF found with MAC fa:16:3e:52:70:a5, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmuxWdlD" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a562a37-6aec-42aa-a9fa-49c293d9146e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmuxWdlD'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[81918383-d9b2-4da5-945d-266f010f3301]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edb010-592d-4540-895c-c2b6e6d8e831]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:47 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:47 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e6178-4073-42b3-a705-e993bde28215]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260]
Nov 15 01:19:47 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260] successful.
Nov 15 01:19:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b029b-2191-4e39-8acd-23387656e1f6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea062fa-a671-44f6-8043-6ef2ba8c83e3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:47 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:47 user nova-compute[74880]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e (non-flash)
Nov 15 01:19:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:47 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:47 user nova-compute[74880]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e (non-flash)
Nov 15 01:19:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea0ece-c8d5-4d8f-8808-d79cffbd5677]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:19:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuxWdlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23335316238623137', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335316238623137', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lazy-loading 'flavor' on Instance uuid d01b6d80-bc59-4981-90a8-a5bd663ae46b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:19:48 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:19:48 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:19:48 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:19:48 user nova-compute[74880]:   <serial>b61a0ba1-9262-49c9-821d-75e9e255786e</serial>
Nov 15 01:19:48 user nova-compute[74880]: </disk>
Nov 15 01:19:48 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-497966bf-42fe-4344-8b59-00d351b6b1c7 req-821b8ec6-89dc-437b-b383-77658a84324f service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-497966bf-42fe-4344-8b59-00d351b6b1c7 req-821b8ec6-89dc-437b-b383-77658a84324f service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-497966bf-42fe-4344-8b59-00d351b6b1c7 req-821b8ec6-89dc-437b-b383-77658a84324f service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-497966bf-42fe-4344-8b59-00d351b6b1c7 req-821b8ec6-89dc-437b-b383-77658a84324f service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-497966bf-42fe-4344-8b59-00d351b6b1c7 req-821b8ec6-89dc-437b-b383-77658a84324f service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:49 user nova-compute[74880]: WARNING nova.compute.manager [req-497966bf-42fe-4344-8b59-00d351b6b1c7 req-821b8ec6-89dc-437b-b383-77658a84324f service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state active and task_state rebuild_spawning.
Nov 15 01:19:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] No VIF found with MAC fa:16:3e:40:8b:9f, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:19:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0add6504-9f7e-41db-a427-01488aaeb519 tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.951s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:50 user nova-compute[74880]: INFO nova.compute.manager [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Terminating instance
Nov 15 01:19:50 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:51 user nova-compute[74880]: WARNING nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state active and task_state rebuild_spawning.
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-vif-unplugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] No waiting events found dispatching network-vif-unplugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-vif-unplugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Acquiring lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] No waiting events found dispatching network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:51 user nova-compute[74880]: WARNING nova.compute.manager [req-887ea5ac-fd34-4178-a01e-ac994a53f2d1 req-a612ebcc-64cf-4ee1-9d06-4aeced701a13 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received unexpected event network-vif-plugged-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 for instance with vm_state active and task_state deleting.
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:51 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Instance destroyed successfully.
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lazy-loading 'resources' on Instance uuid d01b6d80-bc59-4981-90a8-a5bd663ae46b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1582890006',display_name='tempest-DeleteServersTestJSON-server-1582890006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1582890006',id=16,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d5c5912c3d64b998e5d3f72f9fe7ee0',ramdisk_id='',reservation_id='r-jm2hankh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1683354336',owner_user_name='tempest-DeleteServersTestJSON-1683354336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:17:56Z,user_data=None,user_id='a155f47f27764edc928e03eb206878a8',uuid=d01b6d80-bc59-4981-90a8-a5bd663ae46b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Converting VIF {"id": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "address": "fa:16:3e:40:8b:9f", "network": {"id": "08e7e675-eda1-42a4-ba4c-b7527deb44ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1886778856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d5c5912c3d64b998e5d3f72f9fe7ee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9d04f9-13", "ovs_interfaceid": "5d9d04f9-13bb-438f-9fde-afc06ee6dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_vif [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d9d04f9-13, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3181c1e6-a79d-426d-85e2-b36ef9caa6b7) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:51 user nova-compute[74880]: INFO os_vif [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8b:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d9d04f9-13bb-438f-9fde-afc06ee6dbc2,network=Network(08e7e675-eda1-42a4-ba4c-b7527deb44ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9d04f9-13')
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuxWdlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:19:51 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb857986-4ab9-49ab-a306-595e6a2c7d35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:19:51 user nova-compute[74880]: No targets found.
Nov 15 01:19:51 user nova-compute[74880]: iSNS:
Nov 15 01:19:51 user nova-compute[74880]: No targets found.
Nov 15 01:19:51 user nova-compute[74880]: STATIC:
Nov 15 01:19:51 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:19:51 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:19:51 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:19:51 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e
Nov 15 01:19:51 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:19:51 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:19:51 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:19:51 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:19:51 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:19:51 user nova-compute[74880]: FIRMWARE:
Nov 15 01:19:51 user nova-compute[74880]: No targets found.
Nov 15 01:19:51 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:19:51 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:19:51 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb8f66-8f93-48fe-8ed5-1a1ff4f56a42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[374ea708-782d-4c83-8968-9ceeda7a0769]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:51 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:51 user nova-compute[74880]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e (non-flash)
Nov 15 01:19:51 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:19:51 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:19:51 user nova-compute[74880]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e (non-flash)
Nov 15 01:19:51 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d07296c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance spawned successfully.
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff33486-df3f-400e-97ed-33fb0c97025e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce96df04-4710-403b-aec1-eb8a864b702f]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44836c-6b28-42cf-a611-7a828152e208]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea9adf-8f82-4709-8230-a37f6b5c6f01]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[54302671-47b7-4703-a94e-d4d3f6a638e3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8adeb5-c69d-47cd-854b-71dca2ea01a6]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260]
Nov 15 01:19:51 user nova-compute[74880]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e, portal: 172.16.0.220,3260] successful.
Nov 15 01:19:51 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74880) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61a0ba1-9262-49c9-821d-75e9e255786e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfecf264-15e4-4700-a6e8-d4b12d1aad1a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] <== disconnect_volume: return (339ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:19:51 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Deleting instance files /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b_del
Nov 15 01:19:51 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Deletion of /opt/stack/data/nova/instances/d01b6d80-bc59-4981-90a8-a5bd663ae46b_del complete
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac34e9e-8968-479a-8d87-1356e553626d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.034s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:51 user nova-compute[74880]: INFO nova.compute.manager [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 01:19:51 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:19:51 user nova-compute[74880]: INFO nova.compute.claims [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Claim successful on node user
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:19:51 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:19:52 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Took 0.49 seconds to deallocate network for instance.
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:19:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.policy [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f2750a138414933b47db189a233aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fb3f3931294909bfc88b6569034b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:19:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Creating image(s)
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "/opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "/opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "/opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.202s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk 1073741824" returned: 0 in 0.051s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:53 user nova-compute[74880]: INFO nova.compute.manager [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Took 0.86 seconds to detach 1 volumes for instance.
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Successfully created port: 5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-9be886da-ed74-4b5c-be41-7b9548342381 req-e31470b2-6900-4ec6-9adf-a3146fd13003 service nova] [instance: d01b6d80-bc59-4981-90a8-a5bd663ae46b] Received event network-vif-deleted-5d9d04f9-13bb-438f-9fde-afc06ee6dbc2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Cannot resize image /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Ensure instance console log exists: /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:53 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Deleted allocations for instance d01b6d80-bc59-4981-90a8-a5bd663ae46b
Nov 15 01:19:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eaa3b9fb-f2bc-4d22-ae04-e03c5efcc9cf tempest-DeleteServersTestJSON-1683354336 tempest-DeleteServersTestJSON-1683354336-project-member] Lock "d01b6d80-bc59-4981-90a8-a5bd663ae46b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Successfully updated port: 5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquired lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-changed-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Refreshing instance network info cache due to event network-changed-6fe814ba-5ec3-4038-9d2e-694980cd4ed3. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Refreshing network info cache for port 6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-changed-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Refreshing instance network info cache due to event network-changed-5dee47f9-fe9c-485c-bebf-2a38127bfe29. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] Acquiring lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.network.neutron [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updating instance_info_cache with network_info: [{"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Releasing lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Instance network_info: |[{"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] Acquired lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Refreshing network info cache for port 5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Start _get_guest_xml network_info=[{"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:19:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:19:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-811473836',display_name='tempest-VolumesSnapshotTestJSON-instance-811473836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-811473836',id=19,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmlpztN5z9UT6e0A+pbyxLmjgHnvPz/LbO714v8il3uHb9gTGWUeKVHqYJcgLe+ftNK/TursTNoo5jbQ25rvd2Ex9rC30UxW38UvDzyek6e6GEdMRAxCEPxjL+p7AnQiA==',key_name='tempest-keypair-1509311259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb3f3931294909bfc88b6569034b6d',ramdisk_id='',reservation_id='r-cggby9jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-648990630',owner_user_name='tempest-VolumesSnapshotTestJSON-648990630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2750a138414933b47db189a233aaed',uuid=55e471a1-d95f-43c0-a3fc-fb6454202253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converting VIF {"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.objects.instance [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'pci_devices' on Instance uuid 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:19:55 user nova-compute[74880]:   <uuid>55e471a1-d95f-43c0-a3fc-fb6454202253</uuid>
Nov 15 01:19:55 user nova-compute[74880]:   <name>instance-00000013</name>
Nov 15 01:19:55 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:19:55 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:19:55 user nova-compute[74880]:   <metadata>
Nov 15 01:19:55 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:19:55 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:19:55 user nova-compute[74880]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-811473836</nova:name>
Nov 15 01:19:55 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:19:55</nova:creationTime>
Nov 15 01:19:55 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:19:55 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:19:55 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:19:55 user nova-compute[74880]:       <nova:owner>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:user uuid="0f2750a138414933b47db189a233aaed">tempest-VolumesSnapshotTestJSON-648990630-project-member</nova:user>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:project uuid="c6fb3f3931294909bfc88b6569034b6d">tempest-VolumesSnapshotTestJSON-648990630</nova:project>
Nov 15 01:19:55 user nova-compute[74880]:       </nova:owner>
Nov 15 01:19:55 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:19:55 user nova-compute[74880]:       <nova:ports>
Nov 15 01:19:55 user nova-compute[74880]:         <nova:port uuid="5dee47f9-fe9c-485c-bebf-2a38127bfe29">
Nov 15 01:19:55 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:19:55 user nova-compute[74880]:         </nova:port>
Nov 15 01:19:55 user nova-compute[74880]:       </nova:ports>
Nov 15 01:19:55 user nova-compute[74880]:     </nova:instance>
Nov 15 01:19:55 user nova-compute[74880]:   </metadata>
Nov 15 01:19:55 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:19:55 user nova-compute[74880]:     <system>
Nov 15 01:19:55 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:19:55 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:19:55 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:19:55 user nova-compute[74880]:       <entry name="serial">55e471a1-d95f-43c0-a3fc-fb6454202253</entry>
Nov 15 01:19:55 user nova-compute[74880]:       <entry name="uuid">55e471a1-d95f-43c0-a3fc-fb6454202253</entry>
Nov 15 01:19:55 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:19:55 user nova-compute[74880]:     </system>
Nov 15 01:19:55 user nova-compute[74880]:   </sysinfo>
Nov 15 01:19:55 user nova-compute[74880]:   <os>
Nov 15 01:19:55 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:19:55 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:19:55 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:19:55 user nova-compute[74880]:   </os>
Nov 15 01:19:55 user nova-compute[74880]:   <features>
Nov 15 01:19:55 user nova-compute[74880]:     <acpi/>
Nov 15 01:19:55 user nova-compute[74880]:     <apic/>
Nov 15 01:19:55 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:19:55 user nova-compute[74880]:   </features>
Nov 15 01:19:55 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:19:55 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:19:55 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:19:55 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:19:55 user nova-compute[74880]:   </clock>
Nov 15 01:19:55 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:19:55 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:19:55 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:19:55 user nova-compute[74880]:   </cpu>
Nov 15 01:19:55 user nova-compute[74880]:   <devices>
Nov 15 01:19:55 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:19:55 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:19:55 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk"/>
Nov 15 01:19:55 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:19:55 user nova-compute[74880]:     </disk>
Nov 15 01:19:55 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:19:55 user nova-compute[74880]:       <mac address="fa:16:3e:3d:d7:09"/>
Nov 15 01:19:55 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:19:55 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:19:55 user nova-compute[74880]:       <target dev="tap5dee47f9-fe"/>
Nov 15 01:19:55 user nova-compute[74880]:     </interface>
Nov 15 01:19:55 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:19:55 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/console.log" append="off"/>
Nov 15 01:19:55 user nova-compute[74880]:     </serial>
Nov 15 01:19:55 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:19:55 user nova-compute[74880]:     <video>
Nov 15 01:19:55 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:19:55 user nova-compute[74880]:     </video>
Nov 15 01:19:55 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:19:55 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:19:55 user nova-compute[74880]:     </rng>
Nov 15 01:19:55 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:19:55 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:19:55 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:19:55 user nova-compute[74880]:     </memballoon>
Nov 15 01:19:55 user nova-compute[74880]:   </devices>
Nov 15 01:19:55 user nova-compute[74880]: </domain>
Nov 15 01:19:55 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-811473836',display_name='tempest-VolumesSnapshotTestJSON-instance-811473836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-811473836',id=19,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmlpztN5z9UT6e0A+pbyxLmjgHnvPz/LbO714v8il3uHb9gTGWUeKVHqYJcgLe+ftNK/TursTNoo5jbQ25rvd2Ex9rC30UxW38UvDzyek6e6GEdMRAxCEPxjL+p7AnQiA==',key_name='tempest-keypair-1509311259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb3f3931294909bfc88b6569034b6d',ramdisk_id='',reservation_id='r-cggby9jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-648990630',owner_user_name='tempest-VolumesSnapshotTestJSON-648990630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2750a138414933b47db189a233aaed',uuid=55e471a1-d95f-43c0-a3fc-fb6454202253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converting VIF {"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG os_vif [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75d4637f-b8e4-533d-a6e3-cb7cc229b2cb', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dee47f9-fe, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dee47f9-fe, col_values=(('qos', UUID('e60caf04-5ecd-42da-9846-51a8cb84dfa5')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dee47f9-fe, col_values=(('external_ids', {'iface-id': '5dee47f9-fe9c-485c-bebf-2a38127bfe29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:d7:09', 'vm-uuid': '55e471a1-d95f-43c0-a3fc-fb6454202253'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:19:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:55 user nova-compute[74880]: INFO os_vif [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe')
Nov 15 01:19:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No VIF found with MAC fa:16:3e:3d:d7:09, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updated VIF entry in instance network info cache for port 6fe814ba-5ec3-4038-9d2e-694980cd4ed3. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-923fc04b-5c62-48ea-9fd3-4290e471ea74 req-029ff212-5059-4435-9971-12fd3e2c4df1 service nova] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updated VIF entry in instance network info cache for port 5dee47f9-fe9c-485c-bebf-2a38127bfe29. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updating instance_info_cache with network_info: [{"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aad6415a-e878-47f1-9ab2-d51ad83c0d80 req-ceaa72ae-a85e-43d2-ab70-f7a4e7825b1d service nova] Releasing lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:19:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-23ad30d6-ff8e-4440-8756-96459fbb8ad4 req-d1f98248-ee3a-486f-9236-6bc842da0755 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-23ad30d6-ff8e-4440-8756-96459fbb8ad4 req-d1f98248-ee3a-486f-9236-6bc842da0755 service nova] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-23ad30d6-ff8e-4440-8756-96459fbb8ad4 req-d1f98248-ee3a-486f-9236-6bc842da0755 service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-23ad30d6-ff8e-4440-8756-96459fbb8ad4 req-d1f98248-ee3a-486f-9236-6bc842da0755 service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-23ad30d6-ff8e-4440-8756-96459fbb8ad4 req-d1f98248-ee3a-486f-9236-6bc842da0755 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] No waiting events found dispatching network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:57 user nova-compute[74880]: WARNING nova.compute.manager [req-23ad30d6-ff8e-4440-8756-96459fbb8ad4 req-d1f98248-ee3a-486f-9236-6bc842da0755 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received unexpected event network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 for instance with vm_state building and task_state spawning.
Nov 15 01:19:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:19:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Instance spawned successfully.
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:19:59 user nova-compute[74880]: INFO nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Took 7.30 seconds to spawn the instance on the hypervisor.
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-bfdcdfe3-1489-427a-bd51-8c161d255c7e req-8f89e5b2-2515-4d6a-bf4f-5915c5b5e7e3 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bfdcdfe3-1489-427a-bd51-8c161d255c7e req-8f89e5b2-2515-4d6a-bf4f-5915c5b5e7e3 service nova] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bfdcdfe3-1489-427a-bd51-8c161d255c7e req-8f89e5b2-2515-4d6a-bf4f-5915c5b5e7e3 service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bfdcdfe3-1489-427a-bd51-8c161d255c7e req-8f89e5b2-2515-4d6a-bf4f-5915c5b5e7e3 service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:19:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-bfdcdfe3-1489-427a-bd51-8c161d255c7e req-8f89e5b2-2515-4d6a-bf4f-5915c5b5e7e3 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] No waiting events found dispatching network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:19:59 user nova-compute[74880]: WARNING nova.compute.manager [req-bfdcdfe3-1489-427a-bd51-8c161d255c7e req-8f89e5b2-2515-4d6a-bf4f-5915c5b5e7e3 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received unexpected event network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 for instance with vm_state building and task_state spawning.
Nov 15 01:19:59 user nova-compute[74880]: INFO nova.compute.manager [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Took 8.23 seconds to build instance.
Nov 15 01:19:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-21d32a6f-1187-4659-8c27-a4cee3f44b0e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.334s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:20:02 user nova-compute[74880]: INFO nova.compute.claims [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Claim successful on node user
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:20:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:20:02 user nova-compute[74880]: INFO nova.virt.block_device [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Booting with volume 36a84c65-dc09-45db-89fd-d1e2403ae4b5 at /dev/vda
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.policy [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9842f5af61240cfbb507e82bffbc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0a12699b5248acaeb4a4f4e749647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG os_brick.utils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ca907d-6b16-40d8-85a7-4c9a8de2f2cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[13470462-191b-49fd-be94-7cf8bd4083a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7ca14a-dd58-4f3f-8322-8c5fbe2de6f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6329b4d-ff28-4194-bf04-7a9ae31aa3d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:20:02 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:20:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68ba872-5db8-43de-8af9-dfde794cffc8]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG os_brick.utils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:20:02 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating existing volume attachment record: 1e4f4579-a4ae-41f9-8028-eefcbcbbcb00 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:20:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Successfully created port: 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Successfully updated port: 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing instance network info cache due to event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance network_info: |[{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:04 user nova-compute[74880]: INFO nova.compute.manager [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Detaching volume 88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:20:04 user nova-compute[74880]: INFO nova.virt.block_device [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Attempting to driver detach volume 88a0212f-eae8-4d8b-adfa-bde57ca00e4e from mountpoint /dev/vdb
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Attempting to detach device vdb from instance 3afca469-a0b7-4b07-a28a-ead0e367761e from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:20:04 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:20:04 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:20:04 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:20:04 user nova-compute[74880]:   <serial>88a0212f-eae8-4d8b-adfa-bde57ca00e4e</serial>
Nov 15 01:20:04 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:20:04 user nova-compute[74880]: </disk>
Nov 15 01:20:04 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:20:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Successfully detached device vdb from instance 3afca469-a0b7-4b07-a28a-ead0e367761e from the persistent domain config.
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3afca469-a0b7-4b07-a28a-ead0e367761e from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:20:04 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:20:04 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:20:04 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:20:04 user nova-compute[74880]:   <serial>88a0212f-eae8-4d8b-adfa-bde57ca00e4e</serial>
Nov 15 01:20:04 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:20:04 user nova-compute[74880]: </disk>
Nov 15 01:20:04 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updated VIF entry in instance network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f10322e3-46c4-48b1-aaec-179acf037a4b req-42ddb768-44c5-441d-ab88-54d0a7dd9dd1 service nova] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:20:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:20:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Creating image(s)
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Ensure instance console log exists: /opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Start _get_guest_xml network_info=[{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13e06f94-a4f0-4902-ab35-61e4fd7bfc42', 'attached_at': '', 'detached_at': '', 'volume_id': '36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'serial': '36a84c65-dc09-45db-89fd-d1e2403ae4b5'}, 'mount_device': '/dev/vda', 'attachment_id': '1e4f4579-a4ae-41f9-8028-eefcbcbbcb00', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:20:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:20:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:20:08 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:20:08 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:20:08 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a976768-55ab-447d-bb4a-8813ce9ba949]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:20:08 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[033aa9b8-b037-4928-829c-01e5d2cf5475]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5] added
Nov 15 01:20:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[91879a29-d5c5-48d0-af8f-520eb4f3181a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[406741bb-2960-4a17-bbb7-f3c4c2f8c54e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGVTloYy {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGVTloYy" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6babefcc-671e-4476-bc52-dd2414ce5e64]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGVTloYy'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[813bb44c-42c5-4ed8-b102-4125a12371e5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d664de00-d7ed-4e87-b491-f2da13cb87e5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:20:08 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:20:08 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4428c84-36ae-46b0-95f8-4ed8e763b0d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]
Nov 15 01:20:08 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.
Nov 15 01:20:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5f2519-a696-400a-adde-6163817d975d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a6105-26ab-41d8-b76d-c1121e815daa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:20:08 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:08 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:20:08 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:08 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8f2773-4fec-4f29-940d-219c9a68e398]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:20:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23038613762616530', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038613762616530', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-302427772',display_name='tempest-TestShelveInstance-server-302427772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-302427772',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4RRtmqzNYdB6YRArPnATXrgiNoIqLqoruxJJksrsPCwOkLwDLsD5KYHtl9McK9638HYcADKHm6/2lP52nv83so876aZTWJYlRATyrXBsHiPXmV6phECNET/p3TqAgbUg==',key_name='tempest-TestShelveInstance-307644609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0a12699b5248acaeb4a4f4e749647d',ramdisk_id='',reservation_id='r-kdr1j5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1190185298',owner_user_name='tempest-TestShelveInstance-1190185298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:20:03Z,user_data=None,user_id='f9842f5af61240cfbb507e82bffbc15f',uuid=13e06f94-a4f0-4902-ab35-61e4fd7bfc42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converting VIF {"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'pci_devices' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:20:09 user nova-compute[74880]:   <uuid>13e06f94-a4f0-4902-ab35-61e4fd7bfc42</uuid>
Nov 15 01:20:09 user nova-compute[74880]:   <name>instance-00000014</name>
Nov 15 01:20:09 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:20:09 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:20:09 user nova-compute[74880]:   <metadata>
Nov 15 01:20:09 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:20:09 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:20:09 user nova-compute[74880]:       <nova:name>tempest-TestShelveInstance-server-302427772</nova:name>
Nov 15 01:20:09 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:20:08</nova:creationTime>
Nov 15 01:20:09 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:20:09 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:20:09 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:20:09 user nova-compute[74880]:       <nova:owner>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:user uuid="f9842f5af61240cfbb507e82bffbc15f">tempest-TestShelveInstance-1190185298-project-member</nova:user>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:project uuid="0b0a12699b5248acaeb4a4f4e749647d">tempest-TestShelveInstance-1190185298</nova:project>
Nov 15 01:20:09 user nova-compute[74880]:       </nova:owner>
Nov 15 01:20:09 user nova-compute[74880]:       <nova:ports>
Nov 15 01:20:09 user nova-compute[74880]:         <nova:port uuid="5dc4646f-3ae7-4e83-beae-a2da33ad6ce1">
Nov 15 01:20:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:20:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:20:09 user nova-compute[74880]:       </nova:ports>
Nov 15 01:20:09 user nova-compute[74880]:     </nova:instance>
Nov 15 01:20:09 user nova-compute[74880]:   </metadata>
Nov 15 01:20:09 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:20:09 user nova-compute[74880]:     <system>
Nov 15 01:20:09 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:20:09 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:20:09 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:20:09 user nova-compute[74880]:       <entry name="serial">13e06f94-a4f0-4902-ab35-61e4fd7bfc42</entry>
Nov 15 01:20:09 user nova-compute[74880]:       <entry name="uuid">13e06f94-a4f0-4902-ab35-61e4fd7bfc42</entry>
Nov 15 01:20:09 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:20:09 user nova-compute[74880]:     </system>
Nov 15 01:20:09 user nova-compute[74880]:   </sysinfo>
Nov 15 01:20:09 user nova-compute[74880]:   <os>
Nov 15 01:20:09 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:20:09 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:20:09 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:20:09 user nova-compute[74880]:   </os>
Nov 15 01:20:09 user nova-compute[74880]:   <features>
Nov 15 01:20:09 user nova-compute[74880]:     <acpi/>
Nov 15 01:20:09 user nova-compute[74880]:     <apic/>
Nov 15 01:20:09 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:20:09 user nova-compute[74880]:   </features>
Nov 15 01:20:09 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:20:09 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:20:09 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:20:09 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:20:09 user nova-compute[74880]:   </clock>
Nov 15 01:20:09 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:20:09 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:20:09 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:20:09 user nova-compute[74880]:   </cpu>
Nov 15 01:20:09 user nova-compute[74880]:   <devices>
Nov 15 01:20:09 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:20:09 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:20:09 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:20:09 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:20:09 user nova-compute[74880]:       <serial>36a84c65-dc09-45db-89fd-d1e2403ae4b5</serial>
Nov 15 01:20:09 user nova-compute[74880]:     </disk>
Nov 15 01:20:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:20:09 user nova-compute[74880]:       <mac address="fa:16:3e:82:81:3f"/>
Nov 15 01:20:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:20:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:20:09 user nova-compute[74880]:       <target dev="tap5dc4646f-3a"/>
Nov 15 01:20:09 user nova-compute[74880]:     </interface>
Nov 15 01:20:09 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:20:09 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42/console.log" append="off"/>
Nov 15 01:20:09 user nova-compute[74880]:     </serial>
Nov 15 01:20:09 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:20:09 user nova-compute[74880]:     <video>
Nov 15 01:20:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:20:09 user nova-compute[74880]:     </video>
Nov 15 01:20:09 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:20:09 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:20:09 user nova-compute[74880]:     </rng>
Nov 15 01:20:09 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:20:09 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:20:09 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:20:09 user nova-compute[74880]:     </memballoon>
Nov 15 01:20:09 user nova-compute[74880]:   </devices>
Nov 15 01:20:09 user nova-compute[74880]: </domain>
Nov 15 01:20:09 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-302427772',display_name='tempest-TestShelveInstance-server-302427772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-302427772',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4RRtmqzNYdB6YRArPnATXrgiNoIqLqoruxJJksrsPCwOkLwDLsD5KYHtl9McK9638HYcADKHm6/2lP52nv83so876aZTWJYlRATyrXBsHiPXmV6phECNET/p3TqAgbUg==',key_name='tempest-TestShelveInstance-307644609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b0a12699b5248acaeb4a4f4e749647d',ramdisk_id='',reservation_id='r-kdr1j5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1190185298',owner_user_name='tempest-TestShelveInstance-1190185298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:20:03Z,user_data=None,user_id='f9842f5af61240cfbb507e82bffbc15f',uuid=13e06f94-a4f0-4902-ab35-61e4fd7bfc42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converting VIF {"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG os_vif [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c24a25b4-e81e-51cf-80f8-5908418eb4be', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dc4646f-3a, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dc4646f-3a, col_values=(('qos', UUID('dd5577d5-7945-413a-999a-27ce37cc499a')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dc4646f-3a, col_values=(('external_ids', {'iface-id': '5dc4646f-3ae7-4e83-beae-a2da33ad6ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:81:3f', 'vm-uuid': '13e06f94-a4f0-4902-ab35-61e4fd7bfc42'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:09 user nova-compute[74880]: INFO os_vif [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a')
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:20:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] No VIF found with MAC fa:16:3e:82:81:3f, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-034cfa3c-bd40-4a96-9fe3-0bfa465cb55b req-9821dcc2-5c6e-420c-82ec-4ec500664ad9 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-034cfa3c-bd40-4a96-9fe3-0bfa465cb55b req-9821dcc2-5c6e-420c-82ec-4ec500664ad9 service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-034cfa3c-bd40-4a96-9fe3-0bfa465cb55b req-9821dcc2-5c6e-420c-82ec-4ec500664ad9 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-034cfa3c-bd40-4a96-9fe3-0bfa465cb55b req-9821dcc2-5c6e-420c-82ec-4ec500664ad9 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-034cfa3c-bd40-4a96-9fe3-0bfa465cb55b req-9821dcc2-5c6e-420c-82ec-4ec500664ad9 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:11 user nova-compute[74880]: WARNING nova.compute.manager [req-034cfa3c-bd40-4a96-9fe3-0bfa465cb55b req-9821dcc2-5c6e-420c-82ec-4ec500664ad9 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state building and task_state spawning.
Nov 15 01:20:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-ef93a2cf-fce4-4805-86de-1ce8235e7609 req-e88089ef-d13a-490a-859d-ba60d6205484 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ef93a2cf-fce4-4805-86de-1ce8235e7609 req-e88089ef-d13a-490a-859d-ba60d6205484 service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ef93a2cf-fce4-4805-86de-1ce8235e7609 req-e88089ef-d13a-490a-859d-ba60d6205484 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ef93a2cf-fce4-4805-86de-1ce8235e7609 req-e88089ef-d13a-490a-859d-ba60d6205484 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-ef93a2cf-fce4-4805-86de-1ce8235e7609 req-e88089ef-d13a-490a-859d-ba60d6205484 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:13 user nova-compute[74880]: WARNING nova.compute.manager [req-ef93a2cf-fce4-4805-86de-1ce8235e7609 req-e88089ef-d13a-490a-859d-ba60d6205484 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state building and task_state spawning.
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:20:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance spawned successfully.
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:20:13 user nova-compute[74880]: INFO nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:20:13 user nova-compute[74880]: INFO nova.compute.manager [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Took 11.45 seconds to build instance.
Nov 15 01:20:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b73565b2-21e6-426f-b983-36cd90679c8f tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.581s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:13 user nova-compute[74880]: INFO nova.compute.manager [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Unrescuing
Nov 15 01:20:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:13 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:20:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:14 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'flavor' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance destroyed successfully.
Nov 15 01:20:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:15 user nova-compute[74880]: WARNING nova.compute.manager [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:20:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:15 user nova-compute[74880]: WARNING nova.compute.manager [req-247a9737-710c-496f-a95b-cb18ecaa1195 req-d5fa2d31-af51-43ba-b139-e8ce8b5de2b2 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:20:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 2727cc6a-7997-41e6-aaa1-39bce8afdee1 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: INFO nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "46a52acb-8622-452c-824e-66494956c1d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "46a52acb-8622-452c-824e-66494956c1d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:17 user nova-compute[74880]: WARNING nova.compute.manager [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:17 user nova-compute[74880]: WARNING nova.compute.manager [req-53652420-3fdd-4fd8-a0ab-9b807f2bfa9b req-34bb2244-748e-4982-84b6-585973d6a7a8 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:20:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6ac4a6ae-58f3-4a38-b4f5-72a9c27b4003 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:20:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:25 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3afca469-a0b7-4b07-a28a-ead0e367761e is timed out.
Nov 15 01:20:25 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Successfully detached device vdb from instance 3afca469-a0b7-4b07-a28a-ead0e367761e from the live domain config.
Nov 15 01:20:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exnKzCRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:20:25 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0038cbd4-2e24-420c-a93d-9a06ee226d7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:20:25 user nova-compute[74880]: No targets found.
Nov 15 01:20:25 user nova-compute[74880]: iSNS:
Nov 15 01:20:25 user nova-compute[74880]: No targets found.
Nov 15 01:20:25 user nova-compute[74880]: STATIC:
Nov 15 01:20:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e
Nov 15 01:20:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:20:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:20:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:20:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:20:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:20:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:20:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:20:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:20:25 user nova-compute[74880]: FIRMWARE:
Nov 15 01:20:25 user nova-compute[74880]: No targets found.
Nov 15 01:20:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:20:25 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:20:25 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd80baa1-0532-4d75-bb8c-5c1e21b276dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[17682d8a-f6c6-4e9c-958e-850562ad7fae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:20:25 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:25 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e (non-flash)
Nov 15 01:20:25 user nova-compute[74880]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:25 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9513825cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff6ec4-276e-4862-8935-8ce54f438046]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29353d-c164-4ee3-993c-8b3c09dc9621]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619d6bc-d147-490b-9ccd-048ca50918c0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[03106b69-015b-41dd-b341-b692310d7aa7]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed2bc4-379c-4251-ae80-e4c30d979fb5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[121737e0-6b65-4300-9e8e-fc39d98303ed]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260]
Nov 15 01:20:25 user nova-compute[74880]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e, portal: 172.16.0.220,3260] successful.
Nov 15 01:20:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88a0212f-eae8-4d8b-adfa-bde57ca00e4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb896e-96d4-4554-96be-67d484552766]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] <== disconnect_volume: return (305ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:20:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:20:26 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'flavor' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3b22369d-de7e-4126-915f-9575b17b7e51 tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.758s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.968s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-changed-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Refreshing instance network info cache due to event network-changed-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] Acquiring lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] Acquired lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG nova.network.neutron [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Refreshing network info cache for port 0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG nova.network.neutron [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updated VIF entry in instance network info cache for port 0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG nova.network.neutron [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfa53602-cbe2-4282-ac9f-3c66fe2fa393 req-7bafd1b2-cf49-453e-82d4-d1cbdc8b7957 service nova] Releasing lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "interface-46a52acb-8622-452c-824e-66494956c1d9-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "interface-46a52acb-8622-452c-824e-66494956c1d9-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'flavor' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'pci_requests' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:32 user nova-compute[74880]: DEBUG nova.objects.base [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Object Instance<46a52acb-8622-452c-824e-66494956c1d9> lazy-loaded attributes: flavor,pci_requests {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:20:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:20:32 user nova-compute[74880]: DEBUG nova.policy [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ef2db062fde498e9b86bf3be7a3b3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6bb596d6ac4e4bb4204d711308a832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:20:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Successfully created port: 355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Successfully updated port: 355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquired lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-changed-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Refreshing instance network info cache due to event network-changed-355cb491-f10a-4ed5-ae01-37a3dc96fcb9. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:20:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] Acquiring lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.neutron [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Releasing lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] Acquired lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Refreshing network info cache for port 355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG os_vif [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1fccc53-7fed-500a-96a1-b8ee513955d7', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap355cb491-f1, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap355cb491-f1, col_values=(('qos', UUID('e4d18bce-8eb4-4b4a-b0c0-ac594114a09d')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap355cb491-f1, col_values=(('external_ids', {'iface-id': '355cb491-f10a-4ed5-ae01-37a3dc96fcb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:b8:cd', 'vm-uuid': '46a52acb-8622-452c-824e-66494956c1d9'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: INFO os_vif [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1')
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] attach device xml: <interface type="ethernet">
Nov 15 01:20:34 user nova-compute[74880]:   <mac address="fa:16:3e:78:b8:cd"/>
Nov 15 01:20:34 user nova-compute[74880]:   <model type="virtio"/>
Nov 15 01:20:34 user nova-compute[74880]:   <mtu size="1442"/>
Nov 15 01:20:34 user nova-compute[74880]:   <target dev="tap355cb491-f1"/>
Nov 15 01:20:34 user nova-compute[74880]: </interface>
Nov 15 01:20:34 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No BDM found with device name hda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No VIF found with MAC fa:16:3e:17:e4:55, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:20:34 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:20:34 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:20:34 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:20:34</nova:creationTime>
Nov 15 01:20:34 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:20:34 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:20:34 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:20:34 user nova-compute[74880]:   <nova:owner>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:20:34 user nova-compute[74880]:   </nova:owner>
Nov 15 01:20:34 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:20:34 user nova-compute[74880]:   <nova:ports>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:20:34 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:20:34 user nova-compute[74880]:     </nova:port>
Nov 15 01:20:34 user nova-compute[74880]:     <nova:port uuid="355cb491-f10a-4ed5-ae01-37a3dc96fcb9">
Nov 15 01:20:34 user nova-compute[74880]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 15 01:20:34 user nova-compute[74880]:     </nova:port>
Nov 15 01:20:34 user nova-compute[74880]:   </nova:ports>
Nov 15 01:20:34 user nova-compute[74880]: </nova:instance>
Nov 15 01:20:34 user nova-compute[74880]:  {{(pid=74880) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-367b7073-57b9-40f7-bc1d-a56227f367f3 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "interface-46a52acb-8622-452c-824e-66494956c1d9-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.033s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updated VIF entry in instance network info cache for port 355cb491-f10a-4ed5-ae01-37a3dc96fcb9. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-85ae1fa9-79d0-487d-a12a-07716395f812 req-a54559b2-c0ad-4f37-9296-69b63c4ea415 service nova] Releasing lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'flavor' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:35 user nova-compute[74880]: INFO nova.compute.manager [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Attaching volume 981d8563-e4bd-4026-9cfb-6f0c870e1438 to /dev/vdb
Nov 15 01:20:35 user nova-compute[74880]: DEBUG os_brick.utils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb5bf0-9bc1-4309-893c-0f98adc79f0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18c28c0-94af-4253-b49c-547afcb36c06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcaa56e-b312-4c92-9ca9-44cba13df4dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[139630a4-ee51-4ca8-a8be-575f57c1d1c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:20:35 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2262e8f3-50b2-466d-a8b4-61a291623387]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG os_brick.utils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating existing volume attachment record: 965f61b0-13ab-4945-86bb-a97323d897f2 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:35 user nova-compute[74880]: WARNING nova.compute.manager [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 for instance with vm_state active and task_state None.
Nov 15 01:20:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:35 user nova-compute[74880]: WARNING nova.compute.manager [req-7f57344c-0a1d-4a07-a77b-caf827355935 req-0a0e31c8-881e-46ba-8b23-ea9e8b3a9b55 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 for instance with vm_state active and task_state None.
Nov 15 01:20:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVUczasY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:20:40 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:20:40 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:20:40 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ef2e5-2080-4367-bb40-fbcee23edd6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:20:40 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882f3b2-9161-432a-8fbd-19715d38d21f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438] added
Nov 15 01:20:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6967ce-877c-4fd8-a52a-64f72073a773]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee03888e-3a64-45a3-b9d8-b32255f7f75a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVUczasY {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVUczasY" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de9b69-0f84-4b4f-8914-805e41ad0563]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qVUczasY'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7eb45f-5e90-4993-ad30-b7522e7d528a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f59e33-6c4d-46b9-8bc5-417724b68d70]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c9804-df9d-4e10-adef-44228243e108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260]
Nov 15 01:20:40 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260] successful.
Nov 15 01:20:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10b551-0247-40b7-bd60-3d9913c3492d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d26f0d-48e9-4e13-8a9c-50fb66fa5e5c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 (non-flash)
Nov 15 01:20:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d7671c-86c4-4f26-9033-5debf7e432ff]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVUczasY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:20:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23533316230613835', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533316230613835', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'flavor' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:20:41 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:20:41 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:20:41 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:20:41 user nova-compute[74880]:   <serial>981d8563-e4bd-4026-9cfb-6f0c870e1438</serial>
Nov 15 01:20:41 user nova-compute[74880]: </disk>
Nov 15 01:20:41 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No BDM found with device name hda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] No VIF found with MAC fa:16:3e:17:e4:55, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e439257a-a58a-4ce9-94d4-4a8c8df87179 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.136s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:43 user nova-compute[74880]: INFO nova.compute.manager [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Detaching volume 981d8563-e4bd-4026-9cfb-6f0c870e1438
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:43 user nova-compute[74880]: INFO nova.virt.block_device [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Attempting to driver detach volume 981d8563-e4bd-4026-9cfb-6f0c870e1438 from mountpoint /dev/vdb
Nov 15 01:20:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Attempting to detach device vdb from instance 46a52acb-8622-452c-824e-66494956c1d9 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:20:43 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:20:43 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:20:43 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:20:43 user nova-compute[74880]:   <serial>981d8563-e4bd-4026-9cfb-6f0c870e1438</serial>
Nov 15 01:20:43 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 01:20:43 user nova-compute[74880]: </disk>
Nov 15 01:20:43 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:20:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully detached device vdb from instance 46a52acb-8622-452c-824e-66494956c1d9 from the persistent domain config.
Nov 15 01:20:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46a52acb-8622-452c-824e-66494956c1d9 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:20:43 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:20:43 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:20:43 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:20:43 user nova-compute[74880]:   <serial>981d8563-e4bd-4026-9cfb-6f0c870e1438</serial>
Nov 15 01:20:43 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 01:20:43 user nova-compute[74880]: </disk>
Nov 15 01:20:43 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:20:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:20:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7265MB free_disk=25.444957733154297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3afca469-a0b7-4b07-a28a-ead0e367761e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 46a52acb-8622-452c-824e-66494956c1d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 55e471a1-d95f-43c0-a3fc-fb6454202253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:20:47 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:20:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:20:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:55 user nova-compute[74880]: INFO nova.compute.manager [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Terminating instance
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-96dfd93b-9e97-47f6-b1cc-f74192e53a04 req-5e5c9b15-d51d-4c31-b4b1-13dbc1a24ae3 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-96dfd93b-9e97-47f6-b1cc-f74192e53a04 req-5e5c9b15-d51d-4c31-b4b1-13dbc1a24ae3 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-96dfd93b-9e97-47f6-b1cc-f74192e53a04 req-5e5c9b15-d51d-4c31-b4b1-13dbc1a24ae3 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-96dfd93b-9e97-47f6-b1cc-f74192e53a04 req-5e5c9b15-d51d-4c31-b4b1-13dbc1a24ae3 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-96dfd93b-9e97-47f6-b1cc-f74192e53a04 req-5e5c9b15-d51d-4c31-b4b1-13dbc1a24ae3 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-96dfd93b-9e97-47f6-b1cc-f74192e53a04 req-5e5c9b15-d51d-4c31-b4b1-13dbc1a24ae3 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-unplugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:20:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Instance destroyed successfully.
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.objects.instance [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lazy-loading 'resources' on Instance uuid 3afca469-a0b7-4b07-a28a-ead0e367761e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450655807',display_name='tempest-ServerStableDeviceRescueTest-server-450655807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450655807',id=4,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwrMEmNQ+OaLi5r3RGsdmAtnyiEwn6jhXz3iS4rtV/A0KBwCaS4ZTGXRJOA4jmkHs5PWFr+TFCwFtoDdgR5ofHFaKv0cilr24NRRQIMilzrnFRuY0t/mMgCD9nTrkR+zg==',key_name='tempest-keypair-2106614665',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f4176dcde484c0d865259c76ca9f617',ramdisk_id='',reservation_id='r-4jzevtae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-201731109',owner_user_name='tempest-ServerStableDeviceRescueTest-201731109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403f23eeef274791a992f05e07b272b7',uuid=3afca469-a0b7-4b07-a28a-ead0e367761e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converting VIF {"id": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "address": "fa:16:3e:33:94:c9", "network": {"id": "fc669d44-60af-4e93-9efc-2bf014060389", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-864297989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4176dcde484c0d865259c76ca9f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9328a08d-3d", "ovs_interfaceid": "9328a08d-3dad-4b21-9a7c-94361d28d20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG os_vif [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9328a08d-3d, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1407cc3-bbe7-4f00-bf36-c873cc622fcc) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:55 user nova-compute[74880]: INFO os_vif [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:94:c9,bridge_name='br-int',has_traffic_filtering=True,id=9328a08d-3dad-4b21-9a7c-94361d28d20b,network=Network(fc669d44-60af-4e93-9efc-2bf014060389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9328a08d-3d')
Nov 15 01:20:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Deleting instance files /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e_del
Nov 15 01:20:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Deletion of /opt/stack/data/nova/instances/3afca469-a0b7-4b07-a28a-ead0e367761e_del complete
Nov 15 01:20:56 user nova-compute[74880]: INFO nova.compute.manager [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 01:20:56 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:20:56 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:20:56 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:20:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:20:56 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:20:56 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Took 0.73 seconds to deallocate network for instance.
Nov 15 01:20:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-137b909e-8455-460c-86c1-a5eff6fb105e req-315bf54c-39ce-4e25-af4f-eab5c19e9eef service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-deleted-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:57 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Deleted allocations for instance 3afca469-a0b7-4b07-a28a-ead0e367761e
Nov 15 01:20:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-62ee7fe1-f0ed-408e-b83e-6cd071d3454d tempest-ServerStableDeviceRescueTest-201731109 tempest-ServerStableDeviceRescueTest-201731109-project-member] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-992fc3aa-16bc-4c36-9675-331062afd5ca req-527ece02-295a-4d9c-b0e9-2ea3d15166e1 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-992fc3aa-16bc-4c36-9675-331062afd5ca req-527ece02-295a-4d9c-b0e9-2ea3d15166e1 service nova] Acquiring lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-992fc3aa-16bc-4c36-9675-331062afd5ca req-527ece02-295a-4d9c-b0e9-2ea3d15166e1 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-992fc3aa-16bc-4c36-9675-331062afd5ca req-527ece02-295a-4d9c-b0e9-2ea3d15166e1 service nova] Lock "3afca469-a0b7-4b07-a28a-ead0e367761e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-992fc3aa-16bc-4c36-9675-331062afd5ca req-527ece02-295a-4d9c-b0e9-2ea3d15166e1 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] No waiting events found dispatching network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:20:57 user nova-compute[74880]: WARNING nova.compute.manager [req-992fc3aa-16bc-4c36-9675-331062afd5ca req-527ece02-295a-4d9c-b0e9-2ea3d15166e1 service nova] [instance: 3afca469-a0b7-4b07-a28a-ead0e367761e] Received unexpected event network-vif-plugged-9328a08d-3dad-4b21-9a7c-94361d28d20b for instance with vm_state deleted and task_state None.
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:20:59 user nova-compute[74880]: INFO nova.compute.claims [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Claim successful on node user
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:20:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG nova.policy [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d027731a44c4b4eafba314166bd6006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eda993e255245fcbfe4e3044fbe51ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:20:59 user nova-compute[74880]: INFO nova.virt.block_device [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Booting with volume c666dcc3-5e17-4d17-9705-7380b3794086 at /dev/vda
Nov 15 01:20:59 user nova-compute[74880]: DEBUG os_brick.utils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:20:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71db2b2d-cf5e-4464-ba5e-efc55d66da33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[546d6118-8648-4892-8a7d-9c15277f6ef3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3975ad2f-f06a-4a3f-9ef0-74ca3de5a2c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1946c9-b85c-4217-9f81-b04ef49d6d9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:21:00 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:21:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[401186aa-b4b9-4270-9582-79b5fa570048]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG os_brick.utils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updating existing volume attachment record: 30daf315-ff76-425f-80c1-29f8c57bce6b {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Successfully created port: c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:21:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Successfully updated port: c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquired lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-changed-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Refreshing instance network info cache due to event network-changed-c826f62f-3a02-45e7-b066-392cbd32014e. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] Acquiring lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updating instance_info_cache with network_info: [{"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Releasing lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance network_info: |[{"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] Acquired lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Refreshing network info cache for port c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:21:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updated VIF entry in instance network info cache for port c826f62f-3a02-45e7-b066-392cbd32014e. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:21:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updating instance_info_cache with network_info: [{"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dea9cc2b-03e4-429b-8aaf-4e2d8318b892 req-886b0461-b1fc-4275-b2b9-fc5f59dce496 service nova] Releasing lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46a52acb-8622-452c-824e-66494956c1d9 is timed out.
Nov 15 01:21:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully detached device vdb from instance 46a52acb-8622-452c-824e-66494956c1d9 from the live domain config.
Nov 15 01:21:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVUczasY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2792b-cf9d-493a-8dfc-319521183ce0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:21:04 user nova-compute[74880]: No targets found.
Nov 15 01:21:04 user nova-compute[74880]: iSNS:
Nov 15 01:21:04 user nova-compute[74880]: No targets found.
Nov 15 01:21:04 user nova-compute[74880]: STATIC:
Nov 15 01:21:04 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438
Nov 15 01:21:04 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:04 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:04 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:21:04 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:04 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:04 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:21:04 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:04 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:04 user nova-compute[74880]: FIRMWARE:
Nov 15 01:21:04 user nova-compute[74880]: No targets found.
Nov 15 01:21:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:21:04 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:21:04 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd5217-9e3b-4636-bae7-82d186f0340e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413e883-47a7-4a43-ae5c-ea994b3f8bca]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:04 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:04 user nova-compute[74880]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 (non-flash)
Nov 15 01:21:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:04 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:04 user nova-compute[74880]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 (non-flash)
Nov 15 01:21:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d063eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[df391df3-c53a-4c4a-a790-58c45d2f009b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae10652-c1bf-466f-ad74-bbb23b3cc500]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a392e2bd-db63-47a0-a83a-74a62f72fdc0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3cfb59-5e7d-4d14-9b31-9c8d32212ea2]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d725f-e783-4d07-b61e-85e5a444850e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbbabb3-4ee1-4212-9907-e74ba1b47f7f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260]
Nov 15 01:21:04 user nova-compute[74880]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438, portal: 172.16.0.220,3260] successful.
Nov 15 01:21:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981d8563-e4bd-4026-9cfb-6f0c870e1438 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[70089fbc-44c0-45e7-b154-3ef3ef162973]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] <== disconnect_volume: return (319ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:21:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Creating image(s)
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Ensure instance console log exists: /opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Start _get_guest_xml network_info=[{"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c666dcc3-5e17-4d17-9705-7380b3794086', 'serial': 'c666dcc3-5e17-4d17-9705-7380b3794086'}, 'mount_device': '/dev/vda', 'attachment_id': '30daf315-ff76-425f-80c1-29f8c57bce6b', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:21:05 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:21:05 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:05 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:05 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:05 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[835ff18a-c689-4d97-8b28-d9b8a8882a14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:21:05 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[df273a59-59b0-4517-a8a8-155ce15b47a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086] added
Nov 15 01:21:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9aedf-3b9a-4bbc-815c-cdbfe63e6974]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f768248-79bb-4d64-a3ae-bfa2c903b9c6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umrKJaHo {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umrKJaHo" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[14510e69-98c2-41e6-a9b0-e41a1c1d6426]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umrKJaHo'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa37d7-aa43-4b3b-b348-795789cb8ad2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9fa27-c967-4388-8748-dac7d0f2565e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3393d9bc-4850-4547-a6bd-8b25d6b37eab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]
Nov 15 01:21:05 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.
Nov 15 01:21:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'flavor' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[463827f3-c31d-4b2e-8a1d-4b8f37f236a4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[249d43f8-ff88-4a84-9aa0-611b4292172d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[459bc596-728a-4792-82d8-21f438dfa4a3]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9e053337-617f-4f65-9ab3-5714d5381f82 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "interface-46a52acb-8622-452c-824e-66494956c1d9-355cb491-f10a-4ed5-ae01-37a3dc96fcb9" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "interface-46a52acb-8622-452c-824e-66494956c1d9-355cb491-f10a-4ed5-ae01-37a3dc96fcb9" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.objects.instance [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'flavor' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface> {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface> {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Attempting to detach device tap355cb491-f1 from instance 46a52acb-8622-452c-824e-66494956c1d9 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] detach device xml: <interface type="ethernet">
Nov 15 01:21:06 user nova-compute[74880]:   <mac address="fa:16:3e:78:b8:cd"/>
Nov 15 01:21:06 user nova-compute[74880]:   <model type="virtio"/>
Nov 15 01:21:06 user nova-compute[74880]:   <mtu size="1442"/>
Nov 15 01:21:06 user nova-compute[74880]:   <target dev="tap355cb491-f1"/>
Nov 15 01:21:06 user nova-compute[74880]: </interface>
Nov 15 01:21:06 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface> {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 15 01:21:06 user nova-compute[74880]:   <name>instance-00000012</name>
Nov 15 01:21:06 user nova-compute[74880]:   <uuid>46a52acb-8622-452c-824e-66494956c1d9</uuid>
Nov 15 01:21:06 user nova-compute[74880]:   <metadata>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:06 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:21:06 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:21:06 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:20:34</nova:creationTime>
Nov 15 01:21:06 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:21:06 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:06 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:21:06 user nova-compute[74880]:   <nova:owner>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:21:06 user nova-compute[74880]:   </nova:owner>
Nov 15 01:21:06 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:06 user nova-compute[74880]:   <nova:ports>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:21:06 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:21:06 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:port uuid="355cb491-f10a-4ed5-ae01-37a3dc96fcb9">
Nov 15 01:21:06 user nova-compute[74880]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 15 01:21:06 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:06 user nova-compute[74880]:   </nova:ports>
Nov 15 01:21:06 user nova-compute[74880]: </nova:instance>
Nov 15 01:21:06 user nova-compute[74880]:   </metadata>
Nov 15 01:21:06 user nova-compute[74880]:   <memory unit='KiB'>524288</memory>
Nov 15 01:21:06 user nova-compute[74880]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 01:21:06 user nova-compute[74880]:   <vcpu placement='static'>1</vcpu>
Nov 15 01:21:06 user nova-compute[74880]:   <resource>
Nov 15 01:21:06 user nova-compute[74880]:     <partition>/machine</partition>
Nov 15 01:21:06 user nova-compute[74880]:   </resource>
Nov 15 01:21:06 user nova-compute[74880]:   <sysinfo type='smbios'>
Nov 15 01:21:06 user nova-compute[74880]:     <system>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name='version'>0.0.0</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name='serial'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name='uuid'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name='family'>Virtual Machine</entry>
Nov 15 01:21:06 user nova-compute[74880]:     </system>
Nov 15 01:21:06 user nova-compute[74880]:   </sysinfo>
Nov 15 01:21:06 user nova-compute[74880]:   <os>
Nov 15 01:21:06 user nova-compute[74880]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 01:21:06 user nova-compute[74880]:     <boot dev='hd'/>
Nov 15 01:21:06 user nova-compute[74880]:     <smbios mode='sysinfo'/>
Nov 15 01:21:06 user nova-compute[74880]:   </os>
Nov 15 01:21:06 user nova-compute[74880]:   <features>
Nov 15 01:21:06 user nova-compute[74880]:     <acpi/>
Nov 15 01:21:06 user nova-compute[74880]:     <apic/>
Nov 15 01:21:06 user nova-compute[74880]:     <vmcoreinfo state='on'/>
Nov 15 01:21:06 user nova-compute[74880]:   </features>
Nov 15 01:21:06 user nova-compute[74880]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 01:21:06 user nova-compute[74880]:     <model fallback='forbid'>Nehalem</model>
Nov 15 01:21:06 user nova-compute[74880]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 01:21:06 user nova-compute[74880]:     <feature policy='require' name='vme'/>
Nov 15 01:21:06 user nova-compute[74880]:     <feature policy='require' name='x2apic'/>
Nov 15 01:21:06 user nova-compute[74880]:     <feature policy='require' name='hypervisor'/>
Nov 15 01:21:06 user nova-compute[74880]:   </cpu>
Nov 15 01:21:06 user nova-compute[74880]:   <clock offset='utc'>
Nov 15 01:21:06 user nova-compute[74880]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 01:21:06 user nova-compute[74880]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 01:21:06 user nova-compute[74880]:     <timer name='hpet' present='no'/>
Nov 15 01:21:06 user nova-compute[74880]:   </clock>
Nov 15 01:21:06 user nova-compute[74880]:   <on_poweroff>destroy</on_poweroff>
Nov 15 01:21:06 user nova-compute[74880]:   <on_reboot>restart</on_reboot>
Nov 15 01:21:06 user nova-compute[74880]:   <on_crash>destroy</on_crash>
Nov 15 01:21:06 user nova-compute[74880]:   <devices>
Nov 15 01:21:06 user nova-compute[74880]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 01:21:06 user nova-compute[74880]:     <disk type='file' device='disk'>
Nov 15 01:21:06 user nova-compute[74880]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 01:21:06 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk' index='2'/>
Nov 15 01:21:06 user nova-compute[74880]:       <backingStore type='file' index='3'>
Nov 15 01:21:06 user nova-compute[74880]:         <format type='raw'/>
Nov 15 01:21:06 user nova-compute[74880]:         <source file='/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594'/>
Nov 15 01:21:06 user nova-compute[74880]:         <backingStore/>
Nov 15 01:21:06 user nova-compute[74880]:       </backingStore>
Nov 15 01:21:06 user nova-compute[74880]:       <target dev='vda' bus='virtio'/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='virtio-disk0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </disk>
Nov 15 01:21:06 user nova-compute[74880]:     <disk type='file' device='cdrom'>
Nov 15 01:21:06 user nova-compute[74880]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 01:21:06 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config' index='1'/>
Nov 15 01:21:06 user nova-compute[74880]:       <backingStore/>
Nov 15 01:21:06 user nova-compute[74880]:       <target dev='hda' bus='ide'/>
Nov 15 01:21:06 user nova-compute[74880]:       <readonly/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='ide0-0-0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </disk>
Nov 15 01:21:06 user nova-compute[74880]:     <controller type='usb' index='0' model='none'>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='usb'/>
Nov 15 01:21:06 user nova-compute[74880]:     </controller>
Nov 15 01:21:06 user nova-compute[74880]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='pci.0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </controller>
Nov 15 01:21:06 user nova-compute[74880]:     <controller type='ide' index='0'>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='ide'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 01:21:06 user nova-compute[74880]:     </controller>
Nov 15 01:21:06 user nova-compute[74880]:     <interface type='ethernet'>
Nov 15 01:21:06 user nova-compute[74880]:       <mac address='fa:16:3e:17:e4:55'/>
Nov 15 01:21:06 user nova-compute[74880]:       <target dev='tap0bd9c071-fd'/>
Nov 15 01:21:06 user nova-compute[74880]:       <model type='virtio'/>
Nov 15 01:21:06 user nova-compute[74880]:       <mtu size='1442'/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='net0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </interface>
Nov 15 01:21:06 user nova-compute[74880]:     <interface type='ethernet'>
Nov 15 01:21:06 user nova-compute[74880]:       <mac address='fa:16:3e:78:b8:cd'/>
Nov 15 01:21:06 user nova-compute[74880]:       <target dev='tap355cb491-f1'/>
Nov 15 01:21:06 user nova-compute[74880]:       <model type='virtio'/>
Nov 15 01:21:06 user nova-compute[74880]:       <mtu size='1442'/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='net1'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </interface>
Nov 15 01:21:06 user nova-compute[74880]:     <serial type='pty'>
Nov 15 01:21:06 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:06 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:06 user nova-compute[74880]:       <target type='isa-serial' port='0'>
Nov 15 01:21:06 user nova-compute[74880]:         <model name='isa-serial'/>
Nov 15 01:21:06 user nova-compute[74880]:       </target>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </serial>
Nov 15 01:21:06 user nova-compute[74880]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 01:21:06 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:06 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:06 user nova-compute[74880]:       <target type='serial' port='0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </console>
Nov 15 01:21:06 user nova-compute[74880]:     <input type='mouse' bus='ps2'>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='input0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </input>
Nov 15 01:21:06 user nova-compute[74880]:     <input type='keyboard' bus='ps2'>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='input1'/>
Nov 15 01:21:06 user nova-compute[74880]:     </input>
Nov 15 01:21:06 user nova-compute[74880]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 15 01:21:06 user nova-compute[74880]:       <listen type='address' address='0.0.0.0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </graphics>
Nov 15 01:21:06 user nova-compute[74880]:     <audio id='1' type='none'/>
Nov 15 01:21:06 user nova-compute[74880]:     <video>
Nov 15 01:21:06 user nova-compute[74880]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='video0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </video>
Nov 15 01:21:06 user nova-compute[74880]:     <memballoon model='virtio'>
Nov 15 01:21:06 user nova-compute[74880]:       <stats period='10'/>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='balloon0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </memballoon>
Nov 15 01:21:06 user nova-compute[74880]:     <rng model='virtio'>
Nov 15 01:21:06 user nova-compute[74880]:       <backend model='random'>/dev/urandom</backend>
Nov 15 01:21:06 user nova-compute[74880]:       <alias name='rng0'/>
Nov 15 01:21:06 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 01:21:06 user nova-compute[74880]:     </rng>
Nov 15 01:21:06 user nova-compute[74880]:   </devices>
Nov 15 01:21:06 user nova-compute[74880]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 01:21:06 user nova-compute[74880]:     <label>libvirt-46a52acb-8622-452c-824e-66494956c1d9</label>
Nov 15 01:21:06 user nova-compute[74880]:     <imagelabel>libvirt-46a52acb-8622-452c-824e-66494956c1d9</imagelabel>
Nov 15 01:21:06 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:06 user nova-compute[74880]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 01:21:06 user nova-compute[74880]:     <label>+64055:+108</label>
Nov 15 01:21:06 user nova-compute[74880]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 01:21:06 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:06 user nova-compute[74880]: </domain>
Nov 15 01:21:06 user nova-compute[74880]:  {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 01:21:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully detached device tap355cb491-f1 from instance 46a52acb-8622-452c-824e-66494956c1d9 from the persistent domain config.
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] (1/8): Attempting to detach device tap355cb491-f1 with device alias net1 from instance 46a52acb-8622-452c-824e-66494956c1d9 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] detach device xml: <interface type="ethernet">
Nov 15 01:21:06 user nova-compute[74880]:   <mac address="fa:16:3e:78:b8:cd"/>
Nov 15 01:21:06 user nova-compute[74880]:   <model type="virtio"/>
Nov 15 01:21:06 user nova-compute[74880]:   <mtu size="1442"/>
Nov 15 01:21:06 user nova-compute[74880]:   <target dev="tap355cb491-f1"/>
Nov 15 01:21:06 user nova-compute[74880]: </interface>
Nov 15 01:21:06 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26634373264323064', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634373264323064', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-384987413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-384987413',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMcAk9YFgMHc5QC18Zrh41amlCdbanvex0qu/dL79E4oEGET1gLpaDiVdfhJa9wrX/Cm9tleeuTYssjuZ3UjVPqkNb14qffQW15yrfOVUo9LgIFTkjeN4+fRuz5u+VKkA==',key_name='tempest-keypair-1641009201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eda993e255245fcbfe4e3044fbe51ce',ramdisk_id='',reservation_id='r-gi0obfpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-867042238',owner_user_name='tempest-ServerActionsV293TestJSON-867042238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d027731a44c4b4eafba314166bd6006',uuid=2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converting VIF {"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:21:06 user nova-compute[74880]:   <uuid>2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f</uuid>
Nov 15 01:21:06 user nova-compute[74880]:   <name>instance-00000015</name>
Nov 15 01:21:06 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:21:06 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:21:06 user nova-compute[74880]:   <metadata>
Nov 15 01:21:06 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:06 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:21:06 user nova-compute[74880]:       <nova:name>tempest-ServerActionsV293TestJSON-server-384987413</nova:name>
Nov 15 01:21:06 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:21:05</nova:creationTime>
Nov 15 01:21:06 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:21:06 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:06 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:21:06 user nova-compute[74880]:       <nova:owner>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:user uuid="7d027731a44c4b4eafba314166bd6006">tempest-ServerActionsV293TestJSON-867042238-project-member</nova:user>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:project uuid="7eda993e255245fcbfe4e3044fbe51ce">tempest-ServerActionsV293TestJSON-867042238</nova:project>
Nov 15 01:21:06 user nova-compute[74880]:       </nova:owner>
Nov 15 01:21:06 user nova-compute[74880]:       <nova:ports>
Nov 15 01:21:06 user nova-compute[74880]:         <nova:port uuid="c826f62f-3a02-45e7-b066-392cbd32014e">
Nov 15 01:21:06 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 01:21:06 user nova-compute[74880]:         </nova:port>
Nov 15 01:21:06 user nova-compute[74880]:       </nova:ports>
Nov 15 01:21:06 user nova-compute[74880]:     </nova:instance>
Nov 15 01:21:06 user nova-compute[74880]:   </metadata>
Nov 15 01:21:06 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:21:06 user nova-compute[74880]:     <system>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name="serial">2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name="uuid">2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f</entry>
Nov 15 01:21:06 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:21:06 user nova-compute[74880]:     </system>
Nov 15 01:21:06 user nova-compute[74880]:   </sysinfo>
Nov 15 01:21:06 user nova-compute[74880]:   <os>
Nov 15 01:21:06 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:21:06 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:21:06 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:21:06 user nova-compute[74880]:   </os>
Nov 15 01:21:06 user nova-compute[74880]:   <features>
Nov 15 01:21:06 user nova-compute[74880]:     <acpi/>
Nov 15 01:21:06 user nova-compute[74880]:     <apic/>
Nov 15 01:21:06 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:21:06 user nova-compute[74880]:   </features>
Nov 15 01:21:06 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:21:06 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:21:06 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:21:06 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:21:06 user nova-compute[74880]:   </clock>
Nov 15 01:21:06 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:21:06 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:21:06 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:21:06 user nova-compute[74880]:   </cpu>
Nov 15 01:21:06 user nova-compute[74880]:   <devices>
Nov 15 01:21:06 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:21:06 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:21:06 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:21:06 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:21:06 user nova-compute[74880]:       <serial>c666dcc3-5e17-4d17-9705-7380b3794086</serial>
Nov 15 01:21:06 user nova-compute[74880]:     </disk>
Nov 15 01:21:06 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:21:06 user nova-compute[74880]:       <mac address="fa:16:3e:4e:ac:f1"/>
Nov 15 01:21:06 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:21:06 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:21:06 user nova-compute[74880]:       <target dev="tapc826f62f-3a"/>
Nov 15 01:21:06 user nova-compute[74880]:     </interface>
Nov 15 01:21:06 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:21:06 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f/console.log" append="off"/>
Nov 15 01:21:06 user nova-compute[74880]:     </serial>
Nov 15 01:21:06 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:21:06 user nova-compute[74880]:     <video>
Nov 15 01:21:06 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:21:06 user nova-compute[74880]:     </video>
Nov 15 01:21:06 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:21:06 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:21:06 user nova-compute[74880]:     </rng>
Nov 15 01:21:06 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:21:06 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:21:06 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:21:06 user nova-compute[74880]:     </memballoon>
Nov 15 01:21:06 user nova-compute[74880]:   </devices>
Nov 15 01:21:06 user nova-compute[74880]: </domain>
Nov 15 01:21:06 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-384987413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-384987413',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMcAk9YFgMHc5QC18Zrh41amlCdbanvex0qu/dL79E4oEGET1gLpaDiVdfhJa9wrX/Cm9tleeuTYssjuZ3UjVPqkNb14qffQW15yrfOVUo9LgIFTkjeN4+fRuz5u+VKkA==',key_name='tempest-keypair-1641009201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eda993e255245fcbfe4e3044fbe51ce',ramdisk_id='',reservation_id='r-gi0obfpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-867042238',owner_user_name='tempest-ServerActionsV293TestJSON-867042238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d027731a44c4b4eafba314166bd6006',uuid=2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converting VIF {"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG os_vif [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b61fe40-e6de-5eb0-a8b3-9b7243f6cb4b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc826f62f-3a, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc826f62f-3a, col_values=(('qos', UUID('659dd42b-138b-49fc-b17f-41a89f2cb819')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc826f62f-3a, col_values=(('external_ids', {'iface-id': 'c826f62f-3a02-45e7-b066-392cbd32014e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:ac:f1', 'vm-uuid': '2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: INFO os_vif [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a')
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] No VIF found with MAC fa:16:3e:4e:ac:f1, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Start waiting for the detach event from libvirt for device tap355cb491-f1 with device alias net1 for instance 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-09b76cb5-091e-4d52-9570-23ea674c17f8 req-513cc8ec-1836-4c5a-975a-ca98bafc626f service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-unplugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09b76cb5-091e-4d52-9570-23ea674c17f8 req-513cc8ec-1836-4c5a-975a-ca98bafc626f service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09b76cb5-091e-4d52-9570-23ea674c17f8 req-513cc8ec-1836-4c5a-975a-ca98bafc626f service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09b76cb5-091e-4d52-9570-23ea674c17f8 req-513cc8ec-1836-4c5a-975a-ca98bafc626f service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-09b76cb5-091e-4d52-9570-23ea674c17f8 req-513cc8ec-1836-4c5a-975a-ca98bafc626f service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-unplugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:06 user nova-compute[74880]: WARNING nova.compute.manager [req-09b76cb5-091e-4d52-9570-23ea674c17f8 req-513cc8ec-1836-4c5a-975a-ca98bafc626f service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-unplugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 for instance with vm_state active and task_state None.
Nov 15 01:21:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:08 user nova-compute[74880]: WARNING nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-plugged-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 for instance with vm_state active and task_state None.
Nov 15 01:21:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:08 user nova-compute[74880]: WARNING nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state building and task_state spawning.
Nov 15 01:21:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:08 user nova-compute[74880]: WARNING nova.compute.manager [req-e409f911-457b-4e5b-a946-ca952e83bd84 req-8adc3a6d-faa1-411d-afe3-bd2bf92a0f0e service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state building and task_state spawning.
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:21:09 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance spawned successfully.
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:10 user nova-compute[74880]: INFO nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 15 01:21:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:21:10 user nova-compute[74880]: INFO nova.compute.manager [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Took 10.95 seconds to build instance.
Nov 15 01:21:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4064f8cd-bdcb-47f9-81bb-c04edf46530d tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.042s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Waiting for libvirt event about the detach of device tap355cb491-f1 with device alias net1 from instance 46a52acb-8622-452c-824e-66494956c1d9 is timed out.
Nov 15 01:21:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface> {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 15 01:21:26 user nova-compute[74880]:   <name>instance-00000012</name>
Nov 15 01:21:26 user nova-compute[74880]:   <uuid>46a52acb-8622-452c-824e-66494956c1d9</uuid>
Nov 15 01:21:26 user nova-compute[74880]:   <metadata>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:26 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:20:34</nova:creationTime>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:21:26 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:26 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:owner>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:21:26 user nova-compute[74880]:   </nova:owner>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:ports>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:21:26 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:21:26 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:port uuid="355cb491-f10a-4ed5-ae01-37a3dc96fcb9">
Nov 15 01:21:26 user nova-compute[74880]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 15 01:21:26 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:26 user nova-compute[74880]:   </nova:ports>
Nov 15 01:21:26 user nova-compute[74880]: </nova:instance>
Nov 15 01:21:26 user nova-compute[74880]:   </metadata>
Nov 15 01:21:26 user nova-compute[74880]:   <memory unit='KiB'>524288</memory>
Nov 15 01:21:26 user nova-compute[74880]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 01:21:26 user nova-compute[74880]:   <vcpu placement='static'>1</vcpu>
Nov 15 01:21:26 user nova-compute[74880]:   <resource>
Nov 15 01:21:26 user nova-compute[74880]:     <partition>/machine</partition>
Nov 15 01:21:26 user nova-compute[74880]:   </resource>
Nov 15 01:21:26 user nova-compute[74880]:   <sysinfo type='smbios'>
Nov 15 01:21:26 user nova-compute[74880]:     <system>
Nov 15 01:21:26 user nova-compute[74880]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 01:21:26 user nova-compute[74880]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 01:21:26 user nova-compute[74880]:       <entry name='version'>0.0.0</entry>
Nov 15 01:21:26 user nova-compute[74880]:       <entry name='serial'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:26 user nova-compute[74880]:       <entry name='uuid'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:26 user nova-compute[74880]:       <entry name='family'>Virtual Machine</entry>
Nov 15 01:21:26 user nova-compute[74880]:     </system>
Nov 15 01:21:26 user nova-compute[74880]:   </sysinfo>
Nov 15 01:21:26 user nova-compute[74880]:   <os>
Nov 15 01:21:26 user nova-compute[74880]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 01:21:26 user nova-compute[74880]:     <boot dev='hd'/>
Nov 15 01:21:26 user nova-compute[74880]:     <smbios mode='sysinfo'/>
Nov 15 01:21:26 user nova-compute[74880]:   </os>
Nov 15 01:21:26 user nova-compute[74880]:   <features>
Nov 15 01:21:26 user nova-compute[74880]:     <acpi/>
Nov 15 01:21:26 user nova-compute[74880]:     <apic/>
Nov 15 01:21:26 user nova-compute[74880]:     <vmcoreinfo state='on'/>
Nov 15 01:21:26 user nova-compute[74880]:   </features>
Nov 15 01:21:26 user nova-compute[74880]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 01:21:26 user nova-compute[74880]:     <model fallback='forbid'>Nehalem</model>
Nov 15 01:21:26 user nova-compute[74880]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 01:21:26 user nova-compute[74880]:     <feature policy='require' name='vme'/>
Nov 15 01:21:26 user nova-compute[74880]:     <feature policy='require' name='x2apic'/>
Nov 15 01:21:26 user nova-compute[74880]:     <feature policy='require' name='hypervisor'/>
Nov 15 01:21:26 user nova-compute[74880]:   </cpu>
Nov 15 01:21:26 user nova-compute[74880]:   <clock offset='utc'>
Nov 15 01:21:26 user nova-compute[74880]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 01:21:26 user nova-compute[74880]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 01:21:26 user nova-compute[74880]:     <timer name='hpet' present='no'/>
Nov 15 01:21:26 user nova-compute[74880]:   </clock>
Nov 15 01:21:26 user nova-compute[74880]:   <on_poweroff>destroy</on_poweroff>
Nov 15 01:21:26 user nova-compute[74880]:   <on_reboot>restart</on_reboot>
Nov 15 01:21:26 user nova-compute[74880]:   <on_crash>destroy</on_crash>
Nov 15 01:21:26 user nova-compute[74880]:   <devices>
Nov 15 01:21:26 user nova-compute[74880]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 01:21:26 user nova-compute[74880]:     <disk type='file' device='disk'>
Nov 15 01:21:26 user nova-compute[74880]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 01:21:26 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk' index='2'/>
Nov 15 01:21:26 user nova-compute[74880]:       <backingStore type='file' index='3'>
Nov 15 01:21:26 user nova-compute[74880]:         <format type='raw'/>
Nov 15 01:21:26 user nova-compute[74880]:         <source file='/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594'/>
Nov 15 01:21:26 user nova-compute[74880]:         <backingStore/>
Nov 15 01:21:26 user nova-compute[74880]:       </backingStore>
Nov 15 01:21:26 user nova-compute[74880]:       <target dev='vda' bus='virtio'/>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='virtio-disk0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </disk>
Nov 15 01:21:26 user nova-compute[74880]:     <disk type='file' device='cdrom'>
Nov 15 01:21:26 user nova-compute[74880]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 01:21:26 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config' index='1'/>
Nov 15 01:21:26 user nova-compute[74880]:       <backingStore/>
Nov 15 01:21:26 user nova-compute[74880]:       <target dev='hda' bus='ide'/>
Nov 15 01:21:26 user nova-compute[74880]:       <readonly/>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='ide0-0-0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </disk>
Nov 15 01:21:26 user nova-compute[74880]:     <controller type='usb' index='0' model='none'>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='usb'/>
Nov 15 01:21:26 user nova-compute[74880]:     </controller>
Nov 15 01:21:26 user nova-compute[74880]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='pci.0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </controller>
Nov 15 01:21:26 user nova-compute[74880]:     <controller type='ide' index='0'>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='ide'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 01:21:26 user nova-compute[74880]:     </controller>
Nov 15 01:21:26 user nova-compute[74880]:     <interface type='ethernet'>
Nov 15 01:21:26 user nova-compute[74880]:       <mac address='fa:16:3e:17:e4:55'/>
Nov 15 01:21:26 user nova-compute[74880]:       <target dev='tap0bd9c071-fd'/>
Nov 15 01:21:26 user nova-compute[74880]:       <model type='virtio'/>
Nov 15 01:21:26 user nova-compute[74880]:       <mtu size='1442'/>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='net0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </interface>
Nov 15 01:21:26 user nova-compute[74880]:     <serial type='pty'>
Nov 15 01:21:26 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:26 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:26 user nova-compute[74880]:       <target type='isa-serial' port='0'>
Nov 15 01:21:26 user nova-compute[74880]:         <model name='isa-serial'/>
Nov 15 01:21:26 user nova-compute[74880]:       </target>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </serial>
Nov 15 01:21:26 user nova-compute[74880]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 01:21:26 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:26 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:26 user nova-compute[74880]:       <target type='serial' port='0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </console>
Nov 15 01:21:26 user nova-compute[74880]:     <input type='mouse' bus='ps2'>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='input0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </input>
Nov 15 01:21:26 user nova-compute[74880]:     <input type='keyboard' bus='ps2'>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='input1'/>
Nov 15 01:21:26 user nova-compute[74880]:     </input>
Nov 15 01:21:26 user nova-compute[74880]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 15 01:21:26 user nova-compute[74880]:       <listen type='address' address='0.0.0.0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </graphics>
Nov 15 01:21:26 user nova-compute[74880]:     <audio id='1' type='none'/>
Nov 15 01:21:26 user nova-compute[74880]:     <video>
Nov 15 01:21:26 user nova-compute[74880]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='video0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </video>
Nov 15 01:21:26 user nova-compute[74880]:     <memballoon model='virtio'>
Nov 15 01:21:26 user nova-compute[74880]:       <stats period='10'/>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='balloon0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </memballoon>
Nov 15 01:21:26 user nova-compute[74880]:     <rng model='virtio'>
Nov 15 01:21:26 user nova-compute[74880]:       <backend model='random'>/dev/urandom</backend>
Nov 15 01:21:26 user nova-compute[74880]:       <alias name='rng0'/>
Nov 15 01:21:26 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 01:21:26 user nova-compute[74880]:     </rng>
Nov 15 01:21:26 user nova-compute[74880]:   </devices>
Nov 15 01:21:26 user nova-compute[74880]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 01:21:26 user nova-compute[74880]:     <label>libvirt-46a52acb-8622-452c-824e-66494956c1d9</label>
Nov 15 01:21:26 user nova-compute[74880]:     <imagelabel>libvirt-46a52acb-8622-452c-824e-66494956c1d9</imagelabel>
Nov 15 01:21:26 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:26 user nova-compute[74880]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 01:21:26 user nova-compute[74880]:     <label>+64055:+108</label>
Nov 15 01:21:26 user nova-compute[74880]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 01:21:26 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:26 user nova-compute[74880]: </domain>
Nov 15 01:21:26 user nova-compute[74880]:  {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 01:21:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully detached device tap355cb491-f1 from instance 46a52acb-8622-452c-824e-66494956c1d9 from the live domain config.
Nov 15 01:21:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG os_vif [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap355cb491-f1, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4d18bce-8eb4-4b4a-b0c0-ac594114a09d) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:26 user nova-compute[74880]: INFO os_vif [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1')
Nov 15 01:21:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:26 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:21:26</nova:creationTime>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:21:26 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:26 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:owner>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:21:26 user nova-compute[74880]:   </nova:owner>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:26 user nova-compute[74880]:   <nova:ports>
Nov 15 01:21:26 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:21:26 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:21:26 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:26 user nova-compute[74880]:   </nova:ports>
Nov 15 01:21:26 user nova-compute[74880]: </nova:instance>
Nov 15 01:21:26 user nova-compute[74880]:  {{(pid=74880) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 01:21:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-deleted-355cb491-f10a-4ed5-ae01-37a3dc96fcb9 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:27 user nova-compute[74880]: INFO nova.compute.manager [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Neutron deleted interface 355cb491-f10a-4ed5-ae01-37a3dc96fcb9; detaching it from the instance and deleting it from the info cache
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquired lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.network.neutron [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.objects.instance [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Lazy-loading 'system_metadata' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.objects.instance [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Lazy-loading 'flavor' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.objects.base [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Object Instance<46a52acb-8622-452c-824e-66494956c1d9> lazy-loaded attributes: system_metadata,flavor {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.network.os_vif_util [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Converting VIF {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.network.os_vif_util [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface> {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 15 01:21:27 user nova-compute[74880]:   <name>instance-00000012</name>
Nov 15 01:21:27 user nova-compute[74880]:   <uuid>46a52acb-8622-452c-824e-66494956c1d9</uuid>
Nov 15 01:21:27 user nova-compute[74880]:   <metadata>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:27 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:21:26</nova:creationTime>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:21:27 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:owner>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:owner>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:ports>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:21:27 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:21:27 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:ports>
Nov 15 01:21:27 user nova-compute[74880]: </nova:instance>
Nov 15 01:21:27 user nova-compute[74880]:   </metadata>
Nov 15 01:21:27 user nova-compute[74880]:   <memory unit='KiB'>524288</memory>
Nov 15 01:21:27 user nova-compute[74880]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 01:21:27 user nova-compute[74880]:   <vcpu placement='static'>1</vcpu>
Nov 15 01:21:27 user nova-compute[74880]:   <resource>
Nov 15 01:21:27 user nova-compute[74880]:     <partition>/machine</partition>
Nov 15 01:21:27 user nova-compute[74880]:   </resource>
Nov 15 01:21:27 user nova-compute[74880]:   <sysinfo type='smbios'>
Nov 15 01:21:27 user nova-compute[74880]:     <system>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='version'>0.0.0</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='serial'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='uuid'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='family'>Virtual Machine</entry>
Nov 15 01:21:27 user nova-compute[74880]:     </system>
Nov 15 01:21:27 user nova-compute[74880]:   </sysinfo>
Nov 15 01:21:27 user nova-compute[74880]:   <os>
Nov 15 01:21:27 user nova-compute[74880]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 01:21:27 user nova-compute[74880]:     <boot dev='hd'/>
Nov 15 01:21:27 user nova-compute[74880]:     <smbios mode='sysinfo'/>
Nov 15 01:21:27 user nova-compute[74880]:   </os>
Nov 15 01:21:27 user nova-compute[74880]:   <features>
Nov 15 01:21:27 user nova-compute[74880]:     <acpi/>
Nov 15 01:21:27 user nova-compute[74880]:     <apic/>
Nov 15 01:21:27 user nova-compute[74880]:     <vmcoreinfo state='on'/>
Nov 15 01:21:27 user nova-compute[74880]:   </features>
Nov 15 01:21:27 user nova-compute[74880]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 01:21:27 user nova-compute[74880]:     <model fallback='forbid'>Nehalem</model>
Nov 15 01:21:27 user nova-compute[74880]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 01:21:27 user nova-compute[74880]:     <feature policy='require' name='vme'/>
Nov 15 01:21:27 user nova-compute[74880]:     <feature policy='require' name='x2apic'/>
Nov 15 01:21:27 user nova-compute[74880]:     <feature policy='require' name='hypervisor'/>
Nov 15 01:21:27 user nova-compute[74880]:   </cpu>
Nov 15 01:21:27 user nova-compute[74880]:   <clock offset='utc'>
Nov 15 01:21:27 user nova-compute[74880]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 01:21:27 user nova-compute[74880]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 01:21:27 user nova-compute[74880]:     <timer name='hpet' present='no'/>
Nov 15 01:21:27 user nova-compute[74880]:   </clock>
Nov 15 01:21:27 user nova-compute[74880]:   <on_poweroff>destroy</on_poweroff>
Nov 15 01:21:27 user nova-compute[74880]:   <on_reboot>restart</on_reboot>
Nov 15 01:21:27 user nova-compute[74880]:   <on_crash>destroy</on_crash>
Nov 15 01:21:27 user nova-compute[74880]:   <devices>
Nov 15 01:21:27 user nova-compute[74880]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 01:21:27 user nova-compute[74880]:     <disk type='file' device='disk'>
Nov 15 01:21:27 user nova-compute[74880]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 01:21:27 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk' index='2'/>
Nov 15 01:21:27 user nova-compute[74880]:       <backingStore type='file' index='3'>
Nov 15 01:21:27 user nova-compute[74880]:         <format type='raw'/>
Nov 15 01:21:27 user nova-compute[74880]:         <source file='/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594'/>
Nov 15 01:21:27 user nova-compute[74880]:         <backingStore/>
Nov 15 01:21:27 user nova-compute[74880]:       </backingStore>
Nov 15 01:21:27 user nova-compute[74880]:       <target dev='vda' bus='virtio'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='virtio-disk0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </disk>
Nov 15 01:21:27 user nova-compute[74880]:     <disk type='file' device='cdrom'>
Nov 15 01:21:27 user nova-compute[74880]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 01:21:27 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config' index='1'/>
Nov 15 01:21:27 user nova-compute[74880]:       <backingStore/>
Nov 15 01:21:27 user nova-compute[74880]:       <target dev='hda' bus='ide'/>
Nov 15 01:21:27 user nova-compute[74880]:       <readonly/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='ide0-0-0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </disk>
Nov 15 01:21:27 user nova-compute[74880]:     <controller type='usb' index='0' model='none'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='usb'/>
Nov 15 01:21:27 user nova-compute[74880]:     </controller>
Nov 15 01:21:27 user nova-compute[74880]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='pci.0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </controller>
Nov 15 01:21:27 user nova-compute[74880]:     <controller type='ide' index='0'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='ide'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 01:21:27 user nova-compute[74880]:     </controller>
Nov 15 01:21:27 user nova-compute[74880]:     <interface type='ethernet'>
Nov 15 01:21:27 user nova-compute[74880]:       <mac address='fa:16:3e:17:e4:55'/>
Nov 15 01:21:27 user nova-compute[74880]:       <target dev='tap0bd9c071-fd'/>
Nov 15 01:21:27 user nova-compute[74880]:       <model type='virtio'/>
Nov 15 01:21:27 user nova-compute[74880]:       <mtu size='1442'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='net0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </interface>
Nov 15 01:21:27 user nova-compute[74880]:     <serial type='pty'>
Nov 15 01:21:27 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:27 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:27 user nova-compute[74880]:       <target type='isa-serial' port='0'>
Nov 15 01:21:27 user nova-compute[74880]:         <model name='isa-serial'/>
Nov 15 01:21:27 user nova-compute[74880]:       </target>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </serial>
Nov 15 01:21:27 user nova-compute[74880]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 01:21:27 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:27 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:27 user nova-compute[74880]:       <target type='serial' port='0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </console>
Nov 15 01:21:27 user nova-compute[74880]:     <input type='mouse' bus='ps2'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='input0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </input>
Nov 15 01:21:27 user nova-compute[74880]:     <input type='keyboard' bus='ps2'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='input1'/>
Nov 15 01:21:27 user nova-compute[74880]:     </input>
Nov 15 01:21:27 user nova-compute[74880]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 15 01:21:27 user nova-compute[74880]:       <listen type='address' address='0.0.0.0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </graphics>
Nov 15 01:21:27 user nova-compute[74880]:     <audio id='1' type='none'/>
Nov 15 01:21:27 user nova-compute[74880]:     <video>
Nov 15 01:21:27 user nova-compute[74880]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='video0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </video>
Nov 15 01:21:27 user nova-compute[74880]:     <memballoon model='virtio'>
Nov 15 01:21:27 user nova-compute[74880]:       <stats period='10'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='balloon0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </memballoon>
Nov 15 01:21:27 user nova-compute[74880]:     <rng model='virtio'>
Nov 15 01:21:27 user nova-compute[74880]:       <backend model='random'>/dev/urandom</backend>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='rng0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </rng>
Nov 15 01:21:27 user nova-compute[74880]:   </devices>
Nov 15 01:21:27 user nova-compute[74880]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 01:21:27 user nova-compute[74880]:     <label>libvirt-46a52acb-8622-452c-824e-66494956c1d9</label>
Nov 15 01:21:27 user nova-compute[74880]:     <imagelabel>libvirt-46a52acb-8622-452c-824e-66494956c1d9</imagelabel>
Nov 15 01:21:27 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:27 user nova-compute[74880]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 01:21:27 user nova-compute[74880]:     <label>+64055:+108</label>
Nov 15 01:21:27 user nova-compute[74880]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 01:21:27 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:27 user nova-compute[74880]: </domain>
Nov 15 01:21:27 user nova-compute[74880]:  {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface> {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:b8:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap355cb491-f1"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 15 01:21:27 user nova-compute[74880]:   <name>instance-00000012</name>
Nov 15 01:21:27 user nova-compute[74880]:   <uuid>46a52acb-8622-452c-824e-66494956c1d9</uuid>
Nov 15 01:21:27 user nova-compute[74880]:   <metadata>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:27 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:21:26</nova:creationTime>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:21:27 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:owner>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:owner>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:ports>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:21:27 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:21:27 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:ports>
Nov 15 01:21:27 user nova-compute[74880]: </nova:instance>
Nov 15 01:21:27 user nova-compute[74880]:   </metadata>
Nov 15 01:21:27 user nova-compute[74880]:   <memory unit='KiB'>524288</memory>
Nov 15 01:21:27 user nova-compute[74880]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 01:21:27 user nova-compute[74880]:   <vcpu placement='static'>1</vcpu>
Nov 15 01:21:27 user nova-compute[74880]:   <resource>
Nov 15 01:21:27 user nova-compute[74880]:     <partition>/machine</partition>
Nov 15 01:21:27 user nova-compute[74880]:   </resource>
Nov 15 01:21:27 user nova-compute[74880]:   <sysinfo type='smbios'>
Nov 15 01:21:27 user nova-compute[74880]:     <system>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='version'>0.0.0</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='serial'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='uuid'>46a52acb-8622-452c-824e-66494956c1d9</entry>
Nov 15 01:21:27 user nova-compute[74880]:       <entry name='family'>Virtual Machine</entry>
Nov 15 01:21:27 user nova-compute[74880]:     </system>
Nov 15 01:21:27 user nova-compute[74880]:   </sysinfo>
Nov 15 01:21:27 user nova-compute[74880]:   <os>
Nov 15 01:21:27 user nova-compute[74880]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 01:21:27 user nova-compute[74880]:     <boot dev='hd'/>
Nov 15 01:21:27 user nova-compute[74880]:     <smbios mode='sysinfo'/>
Nov 15 01:21:27 user nova-compute[74880]:   </os>
Nov 15 01:21:27 user nova-compute[74880]:   <features>
Nov 15 01:21:27 user nova-compute[74880]:     <acpi/>
Nov 15 01:21:27 user nova-compute[74880]:     <apic/>
Nov 15 01:21:27 user nova-compute[74880]:     <vmcoreinfo state='on'/>
Nov 15 01:21:27 user nova-compute[74880]:   </features>
Nov 15 01:21:27 user nova-compute[74880]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 01:21:27 user nova-compute[74880]:     <model fallback='forbid'>Nehalem</model>
Nov 15 01:21:27 user nova-compute[74880]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 01:21:27 user nova-compute[74880]:     <feature policy='require' name='vme'/>
Nov 15 01:21:27 user nova-compute[74880]:     <feature policy='require' name='x2apic'/>
Nov 15 01:21:27 user nova-compute[74880]:     <feature policy='require' name='hypervisor'/>
Nov 15 01:21:27 user nova-compute[74880]:   </cpu>
Nov 15 01:21:27 user nova-compute[74880]:   <clock offset='utc'>
Nov 15 01:21:27 user nova-compute[74880]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 01:21:27 user nova-compute[74880]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 01:21:27 user nova-compute[74880]:     <timer name='hpet' present='no'/>
Nov 15 01:21:27 user nova-compute[74880]:   </clock>
Nov 15 01:21:27 user nova-compute[74880]:   <on_poweroff>destroy</on_poweroff>
Nov 15 01:21:27 user nova-compute[74880]:   <on_reboot>restart</on_reboot>
Nov 15 01:21:27 user nova-compute[74880]:   <on_crash>destroy</on_crash>
Nov 15 01:21:27 user nova-compute[74880]:   <devices>
Nov 15 01:21:27 user nova-compute[74880]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 01:21:27 user nova-compute[74880]:     <disk type='file' device='disk'>
Nov 15 01:21:27 user nova-compute[74880]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 01:21:27 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk' index='2'/>
Nov 15 01:21:27 user nova-compute[74880]:       <backingStore type='file' index='3'>
Nov 15 01:21:27 user nova-compute[74880]:         <format type='raw'/>
Nov 15 01:21:27 user nova-compute[74880]:         <source file='/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594'/>
Nov 15 01:21:27 user nova-compute[74880]:         <backingStore/>
Nov 15 01:21:27 user nova-compute[74880]:       </backingStore>
Nov 15 01:21:27 user nova-compute[74880]:       <target dev='vda' bus='virtio'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='virtio-disk0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </disk>
Nov 15 01:21:27 user nova-compute[74880]:     <disk type='file' device='cdrom'>
Nov 15 01:21:27 user nova-compute[74880]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 01:21:27 user nova-compute[74880]:       <source file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk.config' index='1'/>
Nov 15 01:21:27 user nova-compute[74880]:       <backingStore/>
Nov 15 01:21:27 user nova-compute[74880]:       <target dev='hda' bus='ide'/>
Nov 15 01:21:27 user nova-compute[74880]:       <readonly/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='ide0-0-0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </disk>
Nov 15 01:21:27 user nova-compute[74880]:     <controller type='usb' index='0' model='none'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='usb'/>
Nov 15 01:21:27 user nova-compute[74880]:     </controller>
Nov 15 01:21:27 user nova-compute[74880]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='pci.0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </controller>
Nov 15 01:21:27 user nova-compute[74880]:     <controller type='ide' index='0'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='ide'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 01:21:27 user nova-compute[74880]:     </controller>
Nov 15 01:21:27 user nova-compute[74880]:     <interface type='ethernet'>
Nov 15 01:21:27 user nova-compute[74880]:       <mac address='fa:16:3e:17:e4:55'/>
Nov 15 01:21:27 user nova-compute[74880]:       <target dev='tap0bd9c071-fd'/>
Nov 15 01:21:27 user nova-compute[74880]:       <model type='virtio'/>
Nov 15 01:21:27 user nova-compute[74880]:       <mtu size='1442'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='net0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </interface>
Nov 15 01:21:27 user nova-compute[74880]:     <serial type='pty'>
Nov 15 01:21:27 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:27 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:27 user nova-compute[74880]:       <target type='isa-serial' port='0'>
Nov 15 01:21:27 user nova-compute[74880]:         <model name='isa-serial'/>
Nov 15 01:21:27 user nova-compute[74880]:       </target>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </serial>
Nov 15 01:21:27 user nova-compute[74880]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 01:21:27 user nova-compute[74880]:       <source path='/dev/pts/6'/>
Nov 15 01:21:27 user nova-compute[74880]:       <log file='/opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/console.log' append='off'/>
Nov 15 01:21:27 user nova-compute[74880]:       <target type='serial' port='0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='serial0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </console>
Nov 15 01:21:27 user nova-compute[74880]:     <input type='mouse' bus='ps2'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='input0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </input>
Nov 15 01:21:27 user nova-compute[74880]:     <input type='keyboard' bus='ps2'>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='input1'/>
Nov 15 01:21:27 user nova-compute[74880]:     </input>
Nov 15 01:21:27 user nova-compute[74880]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 15 01:21:27 user nova-compute[74880]:       <listen type='address' address='0.0.0.0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </graphics>
Nov 15 01:21:27 user nova-compute[74880]:     <audio id='1' type='none'/>
Nov 15 01:21:27 user nova-compute[74880]:     <video>
Nov 15 01:21:27 user nova-compute[74880]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='video0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </video>
Nov 15 01:21:27 user nova-compute[74880]:     <memballoon model='virtio'>
Nov 15 01:21:27 user nova-compute[74880]:       <stats period='10'/>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='balloon0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </memballoon>
Nov 15 01:21:27 user nova-compute[74880]:     <rng model='virtio'>
Nov 15 01:21:27 user nova-compute[74880]:       <backend model='random'>/dev/urandom</backend>
Nov 15 01:21:27 user nova-compute[74880]:       <alias name='rng0'/>
Nov 15 01:21:27 user nova-compute[74880]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 01:21:27 user nova-compute[74880]:     </rng>
Nov 15 01:21:27 user nova-compute[74880]:   </devices>
Nov 15 01:21:27 user nova-compute[74880]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 01:21:27 user nova-compute[74880]:     <label>libvirt-46a52acb-8622-452c-824e-66494956c1d9</label>
Nov 15 01:21:27 user nova-compute[74880]:     <imagelabel>libvirt-46a52acb-8622-452c-824e-66494956c1d9</imagelabel>
Nov 15 01:21:27 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:27 user nova-compute[74880]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 01:21:27 user nova-compute[74880]:     <label>+64055:+108</label>
Nov 15 01:21:27 user nova-compute[74880]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 01:21:27 user nova-compute[74880]:   </seclabel>
Nov 15 01:21:27 user nova-compute[74880]: </domain>
Nov 15 01:21:27 user nova-compute[74880]:  {{(pid=74880) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 01:21:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Detaching interface fa:16:3e:78:b8:cd failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap355cb491-f1' not found.
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.network.os_vif_util [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Converting VIF {"id": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "address": "fa:16:3e:78:b8:cd", "network": {"id": "47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1365423429", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355cb491-f1", "ovs_interfaceid": "355cb491-f10a-4ed5-ae01-37a3dc96fcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.network.os_vif_util [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG os_vif [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap355cb491-f1, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:21:27 user nova-compute[74880]: INFO os_vif [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=355cb491-f10a-4ed5-ae01-37a3dc96fcb9,network=Network(47dc0a9a-ca6d-43eb-bbd7-1d495ad48cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355cb491-f1')
Nov 15 01:21:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [req-7ca69d9b-c76a-4fed-99fc-e740f37c37ee req-a82c70c3-e1aa-4106-8b60-9fcf55c59e0c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:27 user nova-compute[74880]:   <nova:package version="0.0.0"/>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:name>tempest-device-tagging-server-514671914</nova:name>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:creationTime>2023-11-15 01:21:27</nova:creationTime>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:flavor name="m1.tiny">
Nov 15 01:21:27 user nova-compute[74880]:     <nova:memory>512</nova:memory>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:disk>1</nova:disk>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:swap>0</nova:swap>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:flavor>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:owner>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:user uuid="6ef2db062fde498e9b86bf3be7a3b3a0">tempest-TaggedAttachmentsTest-969875148-project-member</nova:user>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:project uuid="8a6bb596d6ac4e4bb4204d711308a832">tempest-TaggedAttachmentsTest-969875148</nova:project>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:owner>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:27 user nova-compute[74880]:   <nova:ports>
Nov 15 01:21:27 user nova-compute[74880]:     <nova:port uuid="0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25">
Nov 15 01:21:27 user nova-compute[74880]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:21:27 user nova-compute[74880]:     </nova:port>
Nov 15 01:21:27 user nova-compute[74880]:   </nova:ports>
Nov 15 01:21:27 user nova-compute[74880]: </nova:instance>
Nov 15 01:21:27 user nova-compute[74880]:  {{(pid=74880) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 01:21:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [{"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Releasing lock "refresh_cache-46a52acb-8622-452c-824e-66494956c1d9" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-284938bf-3ba7-4faa-b2d1-5616688e1493 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "interface-46a52acb-8622-452c-824e-66494956c1d9-355cb491-f10a-4ed5-ae01-37a3dc96fcb9" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.292s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:21:29 user nova-compute[74880]: INFO nova.compute.claims [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Claim successful on node user
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:21:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:21:29 user nova-compute[74880]: DEBUG nova.policy [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8269824ea172423b96ad3d29ff63ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386aadc3b4fe4658b08779ebdb482b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:21:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Creating image(s)
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "/opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "/opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk 1073741824" returned: 0 in 0.048s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Successfully created port: c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Cannot resize image /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Ensure instance console log exists: /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Successfully updated port: c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquired lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-changed-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Refreshing instance network info cache due to event network-changed-c8cc087a-3e14-4498-b978-4af7af884899. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] Acquiring lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updating instance_info_cache with network_info: [{"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Releasing lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Instance network_info: |[{"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] Acquired lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.neutron [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Refreshing network info cache for port c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Start _get_guest_xml network_info=[{"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:21:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:21:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1339519285',display_name='tempest-TestStampPattern-server-1339519285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1339519285',id=22,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG95KHprtUgb5ymRCd6lTxiyqEUi8lMu7mCWG7VewMJuAVjD8xz4kDJVqxJmD8p0wXX5Qzb1MHKG7wVCeJwshyMqg3BWDFP+wfFDMHkCQaSz9lW4qeUs6021F3fVH4Cyyw==',key_name='tempest-TestStampPattern-1850115214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386aadc3b4fe4658b08779ebdb482b5f',ramdisk_id='',reservation_id='r-whsaqp4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1899706846',owner_user_name='tempest-TestStampPattern-1899706846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:21:30Z,user_data=None,user_id='8269824ea172423b96ad3d29ff63ed2f',uuid=ad07de27-3fd2-466c-a066-0b2883bf68a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converting VIF {"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'pci_devices' on Instance uuid ad07de27-3fd2-466c-a066-0b2883bf68a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:21:32 user nova-compute[74880]:   <uuid>ad07de27-3fd2-466c-a066-0b2883bf68a8</uuid>
Nov 15 01:21:32 user nova-compute[74880]:   <name>instance-00000016</name>
Nov 15 01:21:32 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:21:32 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:21:32 user nova-compute[74880]:   <metadata>
Nov 15 01:21:32 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:21:32 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:21:32 user nova-compute[74880]:       <nova:name>tempest-TestStampPattern-server-1339519285</nova:name>
Nov 15 01:21:32 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:21:32</nova:creationTime>
Nov 15 01:21:32 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:21:32 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:21:32 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:21:32 user nova-compute[74880]:       <nova:owner>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:user uuid="8269824ea172423b96ad3d29ff63ed2f">tempest-TestStampPattern-1899706846-project-member</nova:user>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:project uuid="386aadc3b4fe4658b08779ebdb482b5f">tempest-TestStampPattern-1899706846</nova:project>
Nov 15 01:21:32 user nova-compute[74880]:       </nova:owner>
Nov 15 01:21:32 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:21:32 user nova-compute[74880]:       <nova:ports>
Nov 15 01:21:32 user nova-compute[74880]:         <nova:port uuid="c8cc087a-3e14-4498-b978-4af7af884899">
Nov 15 01:21:32 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 01:21:32 user nova-compute[74880]:         </nova:port>
Nov 15 01:21:32 user nova-compute[74880]:       </nova:ports>
Nov 15 01:21:32 user nova-compute[74880]:     </nova:instance>
Nov 15 01:21:32 user nova-compute[74880]:   </metadata>
Nov 15 01:21:32 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:21:32 user nova-compute[74880]:     <system>
Nov 15 01:21:32 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:21:32 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:21:32 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:21:32 user nova-compute[74880]:       <entry name="serial">ad07de27-3fd2-466c-a066-0b2883bf68a8</entry>
Nov 15 01:21:32 user nova-compute[74880]:       <entry name="uuid">ad07de27-3fd2-466c-a066-0b2883bf68a8</entry>
Nov 15 01:21:32 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:21:32 user nova-compute[74880]:     </system>
Nov 15 01:21:32 user nova-compute[74880]:   </sysinfo>
Nov 15 01:21:32 user nova-compute[74880]:   <os>
Nov 15 01:21:32 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:21:32 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:21:32 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:21:32 user nova-compute[74880]:   </os>
Nov 15 01:21:32 user nova-compute[74880]:   <features>
Nov 15 01:21:32 user nova-compute[74880]:     <acpi/>
Nov 15 01:21:32 user nova-compute[74880]:     <apic/>
Nov 15 01:21:32 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:21:32 user nova-compute[74880]:   </features>
Nov 15 01:21:32 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:21:32 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:21:32 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:21:32 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:21:32 user nova-compute[74880]:   </clock>
Nov 15 01:21:32 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:21:32 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:21:32 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:21:32 user nova-compute[74880]:   </cpu>
Nov 15 01:21:32 user nova-compute[74880]:   <devices>
Nov 15 01:21:32 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:21:32 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:21:32 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk"/>
Nov 15 01:21:32 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:21:32 user nova-compute[74880]:     </disk>
Nov 15 01:21:32 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:21:32 user nova-compute[74880]:       <mac address="fa:16:3e:5c:16:be"/>
Nov 15 01:21:32 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:21:32 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:21:32 user nova-compute[74880]:       <target dev="tapc8cc087a-3e"/>
Nov 15 01:21:32 user nova-compute[74880]:     </interface>
Nov 15 01:21:32 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:21:32 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/console.log" append="off"/>
Nov 15 01:21:32 user nova-compute[74880]:     </serial>
Nov 15 01:21:32 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:21:32 user nova-compute[74880]:     <video>
Nov 15 01:21:32 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:21:32 user nova-compute[74880]:     </video>
Nov 15 01:21:32 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:21:32 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:21:32 user nova-compute[74880]:     </rng>
Nov 15 01:21:32 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:21:32 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:21:32 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:21:32 user nova-compute[74880]:     </memballoon>
Nov 15 01:21:32 user nova-compute[74880]:   </devices>
Nov 15 01:21:32 user nova-compute[74880]: </domain>
Nov 15 01:21:32 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1339519285',display_name='tempest-TestStampPattern-server-1339519285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1339519285',id=22,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG95KHprtUgb5ymRCd6lTxiyqEUi8lMu7mCWG7VewMJuAVjD8xz4kDJVqxJmD8p0wXX5Qzb1MHKG7wVCeJwshyMqg3BWDFP+wfFDMHkCQaSz9lW4qeUs6021F3fVH4Cyyw==',key_name='tempest-TestStampPattern-1850115214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386aadc3b4fe4658b08779ebdb482b5f',ramdisk_id='',reservation_id='r-whsaqp4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1899706846',owner_user_name='tempest-TestStampPattern-1899706846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:21:30Z,user_data=None,user_id='8269824ea172423b96ad3d29ff63ed2f',uuid=ad07de27-3fd2-466c-a066-0b2883bf68a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converting VIF {"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG os_vif [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9caa32f9-7dd9-5064-b2e7-8bd77a0a58f0', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8cc087a-3e, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8cc087a-3e, col_values=(('qos', UUID('3d943b23-f707-4a09-9df9-c3825d0be667')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8cc087a-3e, col_values=(('external_ids', {'iface-id': 'c8cc087a-3e14-4498-b978-4af7af884899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:16:be', 'vm-uuid': 'ad07de27-3fd2-466c-a066-0b2883bf68a8'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:32 user nova-compute[74880]: INFO os_vif [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e')
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No VIF found with MAC fa:16:3e:5c:16:be, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.neutron [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updated VIF entry in instance network info cache for port c8cc087a-3e14-4498-b978-4af7af884899. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG nova.network.neutron [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updating instance_info_cache with network_info: [{"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e996442-0214-4321-814c-6054bd257db4 req-442d280f-d5d4-497c-b879-aa5b9a217ed0 service nova] Releasing lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-a77b48fc-9297-4780-9b60-acf7e665b655 req-2c3cfeb7-ed12-46f8-a414-72fb0f048fc9 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a77b48fc-9297-4780-9b60-acf7e665b655 req-2c3cfeb7-ed12-46f8-a414-72fb0f048fc9 service nova] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a77b48fc-9297-4780-9b60-acf7e665b655 req-2c3cfeb7-ed12-46f8-a414-72fb0f048fc9 service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a77b48fc-9297-4780-9b60-acf7e665b655 req-2c3cfeb7-ed12-46f8-a414-72fb0f048fc9 service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-a77b48fc-9297-4780-9b60-acf7e665b655 req-2c3cfeb7-ed12-46f8-a414-72fb0f048fc9 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] No waiting events found dispatching network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:33 user nova-compute[74880]: WARNING nova.compute.manager [req-a77b48fc-9297-4780-9b60-acf7e665b655 req-2c3cfeb7-ed12-46f8-a414-72fb0f048fc9 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received unexpected event network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 for instance with vm_state building and task_state spawning.
Nov 15 01:21:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:21:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Instance spawned successfully.
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:21:35 user nova-compute[74880]: INFO nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-cfc80f87-bcf6-4add-bb30-bb5ca1b18840 req-a48a8744-91a2-4da2-815c-3af5a8280ae4 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfc80f87-bcf6-4add-bb30-bb5ca1b18840 req-a48a8744-91a2-4da2-815c-3af5a8280ae4 service nova] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfc80f87-bcf6-4add-bb30-bb5ca1b18840 req-a48a8744-91a2-4da2-815c-3af5a8280ae4 service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cfc80f87-bcf6-4add-bb30-bb5ca1b18840 req-a48a8744-91a2-4da2-815c-3af5a8280ae4 service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-cfc80f87-bcf6-4add-bb30-bb5ca1b18840 req-a48a8744-91a2-4da2-815c-3af5a8280ae4 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] No waiting events found dispatching network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:35 user nova-compute[74880]: WARNING nova.compute.manager [req-cfc80f87-bcf6-4add-bb30-bb5ca1b18840 req-a48a8744-91a2-4da2-815c-3af5a8280ae4 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received unexpected event network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 for instance with vm_state building and task_state spawning.
Nov 15 01:21:35 user nova-compute[74880]: INFO nova.compute.manager [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Took 6.52 seconds to build instance.
Nov 15 01:21:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d7bc60fd-9886-4ce4-971e-c2fe8c3324a7 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.617s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:38 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:21:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-changed-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Refreshing instance network info cache due to event network-changed-5dee47f9-fe9c-485c-bebf-2a38127bfe29. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] Acquiring lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] Acquired lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.network.neutron [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Refreshing network info cache for port 5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'flavor' on Instance uuid 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Ignoring supplied device name: /dev/vdb
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.network.neutron [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updated VIF entry in instance network info cache for port 5dee47f9-fe9c-485c-bebf-2a38127bfe29. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG nova.network.neutron [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updating instance_info_cache with network_info: [{"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:42 user nova-compute[74880]: INFO nova.compute.manager [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Attaching volume 43ff12f5-c053-45c0-b032-4af5541dae2c to /dev/vdb
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-982ede0e-7a01-453c-b0ed-afc1c67406c3 req-605946db-f27b-4cb6-a418-7578430ef9fe service nova] Releasing lock "refresh_cache-55e471a1-d95f-43c0-a3fc-fb6454202253" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG os_brick.utils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee753b2-45eb-4571-9b2e-36ba6813dd3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b8e158-c0fe-4320-bc4f-d121551fb87c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56ba896-b8aa-433a-bdd5-7fb93e66cbdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c470bd06-1c48-47a1-84dd-15f9fa96ff9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:21:43 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f80d93-5138-4344-a601-045112b0f437]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG os_brick.utils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updating existing volume attachment record: 725b75b8-ca3c-4875-89b7-04a4de698413 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:21:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:21:45 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7408MB free_disk=25.555374145507812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 46a52acb-8622-452c-824e-66494956c1d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 55e471a1-d95f-43c0-a3fc-fb6454202253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:21:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQcoVrAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:47 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:48 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:48 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f2e08a-0376-439c-9636-f2743e89c7c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:21:48 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5693e60-8437-4285-9f7b-e9c01a91ff2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c] added
Nov 15 01:21:48 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e4a053-2e47-48d7-90cb-eab2dc8b5a37]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0773fd18-cfaf-46a7-8b35-b25d31af72f4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQcoVrAh {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQcoVrAh" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9bd34-1ddd-4032-be1f-28af3c3ac4ee]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BQcoVrAh'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a9b47-8aab-438c-aefe-9d6f770b69cc]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd09bbe9-b407-4720-a644-ab97d07a23ab]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1395375c-a750-460f-894e-cdd826d7f545]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260]
Nov 15 01:21:48 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260] successful.
Nov 15 01:21:48 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b3bc40-f028-447e-b280-2d0fd47ebe44]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c92c63e-b55f-4ac8-b2ef-c444053a5a77]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:48 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:48 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:48 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e7b9ed-1b0a-48f4-8a40-ec272a0ec3f4]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQcoVrAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'flavor' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:48 user nova-compute[74880]: INFO nova.compute.manager [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Attaching volume 1ed8b916-c70c-4ec7-8424-efb9d161d7e9 to /dev/vdb
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.utils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.046s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[023859c0-a4de-418a-837a-02fc7e2578b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dadb83b-edbb-4820-9d9e-576dff5dc3e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160dc99-ff62-48f2-89dc-29dba2994f48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee6918-0005-4350-aa61-d48fc8c55409]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:21:48 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:21:48 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbe5187-d4fd-412b-878f-da95a4ab0364]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG os_brick.utils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating existing volume attachment record: 4b7476d1-3750-4908-a397-899b5db66a54 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23139353932383464', 'path': '/dev/sde'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139353932383464', 'path': '/dev/sde'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'flavor' on Instance uuid 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:21:49 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:21:49 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:21:49 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:21:49 user nova-compute[74880]:   <serial>43ff12f5-c053-45c0-b032-4af5541dae2c</serial>
Nov 15 01:21:49 user nova-compute[74880]: </disk>
Nov 15 01:21:49 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No VIF found with MAC fa:16:3e:3d:d7:09, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:21:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2602783b-cd6a-4049-9af2-ec5f2852efea tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.083s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:53 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:53 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:53 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c212a-b12f-46ab-be0a-47f3b9431afa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:21:53 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8478ba8-ce9a-4c20-b768-b72d74e58876]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9] added
Nov 15 01:21:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b0562-163e-427f-8c50-19909a8a5ad1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc938c5f-84ef-43cf-84f6-bb953c9494f0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzapVJQv {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzapVJQv" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b73e807-8a7f-411b-a8c8-f7c13f06ccc3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZzapVJQv'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b946572e-de22-4e50-9464-bc25bed08742]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7ca25a-f3e5-41ff-9cf4-b1e0a0034b26]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:53 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:53 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:53 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:53 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:53 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:53 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[567a4346-f216-45e5-b174-529a032cfd10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]
Nov 15 01:21:54 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.
Nov 15 01:21:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a7e276-89f9-49d6-beff-96aee255ccfc]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[917702e8-3b58-45e9-bf8c-73fc088646ed]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:54 user nova-compute[74880]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:21:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcaf347-e216-4ff6-a693-6333d9f9af03]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing instance network info cache due to event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updated VIF entry in instance network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1f329cc0-13d8-4d3e-b2b1-65cb66f7bd6d req-c739ff9e-cee1-4539-8beb-5bdf24aef63a service nova] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:55 user nova-compute[74880]: INFO nova.compute.manager [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Shelve offloading
Nov 15 01:21:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26463616331346332', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463616331346332', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'flavor' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:21:55 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:21:55 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:21:55 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:21:55 user nova-compute[74880]:   <serial>1ed8b916-c70c-4ec7-8424-efb9d161d7e9</serial>
Nov 15 01:21:55 user nova-compute[74880]: </disk>
Nov 15 01:21:55 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f00f1ce-b545-4eed-8d8b-ebecf33ae7f6 req-1f0fd3a7-ee92-4e5c-8fda-8ad087ce0480 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-unplugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f00f1ce-b545-4eed-8d8b-ebecf33ae7f6 req-1f0fd3a7-ee92-4e5c-8fda-8ad087ce0480 service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f00f1ce-b545-4eed-8d8b-ebecf33ae7f6 req-1f0fd3a7-ee92-4e5c-8fda-8ad087ce0480 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f00f1ce-b545-4eed-8d8b-ebecf33ae7f6 req-1f0fd3a7-ee92-4e5c-8fda-8ad087ce0480 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f00f1ce-b545-4eed-8d8b-ebecf33ae7f6 req-1f0fd3a7-ee92-4e5c-8fda-8ad087ce0480 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-unplugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:55 user nova-compute[74880]: WARNING nova.compute.manager [req-3f00f1ce-b545-4eed-8d8b-ebecf33ae7f6 req-1f0fd3a7-ee92-4e5c-8fda-8ad087ce0480 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-unplugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state active and task_state shelving.
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No VIF found with MAC fa:16:3e:0f:db:87, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f29a13a6-3896-4b98-8772-fe9bdc1fb7dc tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.976s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance destroyed successfully.
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:55 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:21:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.compute.manager [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Terminating instance
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance destroyed successfully.
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'resources' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-302427772',display_name='tempest-TestShelveInstance-server-302427772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-302427772',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4RRtmqzNYdB6YRArPnATXrgiNoIqLqoruxJJksrsPCwOkLwDLsD5KYHtl9McK9638HYcADKHm6/2lP52nv83so876aZTWJYlRATyrXBsHiPXmV6phECNET/p3TqAgbUg==',key_name='tempest-TestShelveInstance-307644609',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b0a12699b5248acaeb4a4f4e749647d',ramdisk_id='',reservation_id='r-kdr1j5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1190185298',owner_user_name='tempest-TestShelveInstance-1190185298-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:20:14Z,user_data=None,user_id='f9842f5af61240cfbb507e82bffbc15f',uuid=13e06f94-a4f0-4902-ab35-61e4fd7bfc42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converting VIF {"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_vif [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dc4646f-3a, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd5577d5-7945-413a-999a-27ce37cc499a) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: INFO os_vif [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a')
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:21:57 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f13ef5-1d00-46a7-81d0-64513608f523]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:21:57 user nova-compute[74880]: No targets found.
Nov 15 01:21:57 user nova-compute[74880]: iSNS:
Nov 15 01:21:57 user nova-compute[74880]: No targets found.
Nov 15 01:21:57 user nova-compute[74880]: STATIC:
Nov 15 01:21:57 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:21:57 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:57 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:57 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:21:57 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:57 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:57 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:21:57 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:57 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:57 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c
Nov 15 01:21:57 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:57 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:57 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:21:57 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:21:57 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:21:57 user nova-compute[74880]: FIRMWARE:
Nov 15 01:21:57 user nova-compute[74880]: No targets found.
Nov 15 01:21:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:21:57 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:21:57 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4baa3d7-a60f-4216-8de7-c53db070db42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:57 user nova-compute[74880]: WARNING nova.compute.manager [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state active and task_state shelving.
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing instance network info cache due to event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14bf57-6363-4eb6-a823-d7480d5c78e5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:21:57 user nova-compute[74880]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:21:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f950811e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-87dd1e0d-ee14-4dc3-91a7-8d2d0ba43e29 req-174fc341-4d9c-44fe-b2b4-1c15f4e45c5f service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-unplugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87dd1e0d-ee14-4dc3-91a7-8d2d0ba43e29 req-174fc341-4d9c-44fe-b2b4-1c15f4e45c5f service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87dd1e0d-ee14-4dc3-91a7-8d2d0ba43e29 req-174fc341-4d9c-44fe-b2b4-1c15f4e45c5f service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87dd1e0d-ee14-4dc3-91a7-8d2d0ba43e29 req-174fc341-4d9c-44fe-b2b4-1c15f4e45c5f service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-87dd1e0d-ee14-4dc3-91a7-8d2d0ba43e29 req-174fc341-4d9c-44fe-b2b4-1c15f4e45c5f service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-unplugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-87dd1e0d-ee14-4dc3-91a7-8d2d0ba43e29 req-174fc341-4d9c-44fe-b2b4-1c15f4e45c5f service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-unplugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dbf3eb-d358-409b-b9cd-0b323c605df0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a7af9d-60ef-4b27-a1ca-e4069a2a544d]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599665e-164f-4678-8292-0b99f19f260b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021c9e4-381f-4f50-9c01-90d27aa9b1ff]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdff3fc8-24ad-4e44-8670-e7d2558dafe0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b220c-1f8e-4662-b559-7bb92b290fa7]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]
Nov 15 01:21:57 user nova-compute[74880]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.
Nov 15 01:21:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[05447bc2-d94d-4df8-80d0-7022c779a0b6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] <== disconnect_volume: return (391ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Deleting instance files /opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42_del
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Deletion of /opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42_del complete
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Instance destroyed successfully.
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lazy-loading 'resources' on Instance uuid 46a52acb-8622-452c-824e-66494956c1d9 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T01:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-514671914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-514671914',id=18,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnCfDR4bfdoeGtJ2QkAq4qyjxlsfZJuQElA3zyRrnzK2s+Dv+i5Favr1N68Vs/Azo5mDwGaTW0g5oxIWDKH+YFCA1azhyT8UvOMoZDHp18llYl6OiIeueJcmeC69UaVrw==',key_name='tempest-keypair-1805334267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6bb596d6ac4e4bb4204d711308a832',ramdisk_id='',reservation_id='r-q1o17uub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-969875148',owner_user_name='tempest-TaggedAttachmentsTest-969875148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef2db062fde498e9b86bf3be7a3b3a0',uuid=46a52acb-8622-452c-824e-66494956c1d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converting VIF {"id": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "address": "fa:16:3e:17:e4:55", "network": {"id": "91150a66-a5bc-43d3-b515-ab5ac4394419", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-806825065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6bb596d6ac4e4bb4204d711308a832", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9c071-fd", "ovs_interfaceid": "0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG os_vif [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bd9c071-fd, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updated VIF entry in instance network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": null, "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c45fb21a-a868-45f3-af52-deee8a8175cc) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:21:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:21:57 user nova-compute[74880]: INFO os_vif [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e4:55,bridge_name='br-int',has_traffic_filtering=True,id=0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25,network=Network(91150a66-a5bc-43d3-b515-ab5ac4394419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9c071-fd')
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Deleting instance files /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9_del
Nov 15 01:21:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Deletion of /opt/stack/data/nova/instances/46a52acb-8622-452c-824e-66494956c1d9_del complete
Nov 15 01:21:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e6faa6a0-5486-4899-916c-59fc972eea72 req-034a4313-df38-4634-a1c9-50c0ae7fc114 service nova] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:21:58 user nova-compute[74880]: INFO nova.compute.manager [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 01:21:58 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:21:58 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:21:58 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 46a52acb-8622-452c-824e-66494956c1d9] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:21:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Stashing vm_state: active {{(pid=74880) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 01:21:58 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Deleted allocations for instance 13e06f94-a4f0-4902-ab35-61e4fd7bfc42
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'numa_topology' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:21:59 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Took 1.11 seconds to deallocate network for instance.
Nov 15 01:21:59 user nova-compute[74880]: INFO nova.compute.manager [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Detaching volume 43ff12f5-c053-45c0-b032-4af5541dae2c
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.objects.base [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Object Instance<13e06f94-a4f0-4902-ab35-61e4fd7bfc42> lazy-loaded attributes: resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:59 user nova-compute[74880]: INFO nova.virt.block_device [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Attempting to driver detach volume 43ff12f5-c053-45c0-b032-4af5541dae2c from mountpoint /dev/vdb
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Attempting to detach device vdb from instance 55e471a1-d95f-43c0-a3fc-fb6454202253 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:21:59 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:21:59 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:21:59 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:21:59 user nova-compute[74880]:   <serial>43ff12f5-c053-45c0-b032-4af5541dae2c</serial>
Nov 15 01:21:59 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:21:59 user nova-compute[74880]: </disk>
Nov 15 01:21:59 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:21:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully detached device vdb from instance 55e471a1-d95f-43c0-a3fc-fb6454202253 from the persistent domain config.
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55e471a1-d95f-43c0-a3fc-fb6454202253 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:21:59 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:21:59 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:21:59 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:21:59 user nova-compute[74880]:   <serial>43ff12f5-c053-45c0-b032-4af5541dae2c</serial>
Nov 15 01:21:59 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:21:59 user nova-compute[74880]: </disk>
Nov 15 01:21:59 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-74961605-35f3-480c-8830-c8c8e58ba77d req-54c8c10a-effb-439e-acbd-17309de18e84 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-deleted-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-b395c8e1-1c6e-40ec-97cc-a5f1dc95dea6 req-b2e8fdbd-32be-4e59-a242-15cf9dd15148 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received event network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b395c8e1-1c6e-40ec-97cc-a5f1dc95dea6 req-b2e8fdbd-32be-4e59-a242-15cf9dd15148 service nova] Acquiring lock "46a52acb-8622-452c-824e-66494956c1d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b395c8e1-1c6e-40ec-97cc-a5f1dc95dea6 req-b2e8fdbd-32be-4e59-a242-15cf9dd15148 service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b395c8e1-1c6e-40ec-97cc-a5f1dc95dea6 req-b2e8fdbd-32be-4e59-a242-15cf9dd15148 service nova] Lock "46a52acb-8622-452c-824e-66494956c1d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-b395c8e1-1c6e-40ec-97cc-a5f1dc95dea6 req-b2e8fdbd-32be-4e59-a242-15cf9dd15148 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] No waiting events found dispatching network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:21:59 user nova-compute[74880]: WARNING nova.compute.manager [req-b395c8e1-1c6e-40ec-97cc-a5f1dc95dea6 req-b2e8fdbd-32be-4e59-a242-15cf9dd15148 service nova] [instance: 46a52acb-8622-452c-824e-66494956c1d9] Received unexpected event network-vif-plugged-0bd9c071-fdcc-4e8f-9be8-f3e9423f4f25 for instance with vm_state deleted and task_state None.
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.524s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:21:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:21:59 user nova-compute[74880]: INFO nova.compute.claims [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Claim successful on node user
Nov 15 01:21:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e10dd637-db02-413e-ad8a-9f58ae6d43e2 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.755s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:21:59 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating resource usage from migration 112272ae-b8e1-460b-a20e-0623a226c748
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.578s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:00 user nova-compute[74880]: INFO nova.compute.manager [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Migrating
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.053s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:00 user nova-compute[74880]: INFO nova.compute.rpcapi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.network.neutron [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:00 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Deleted allocations for instance 46a52acb-8622-452c-824e-66494956c1d9
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ead6c445-8601-44a2-a56b-16f7c93db1a1 tempest-TaggedAttachmentsTest-969875148 tempest-TaggedAttachmentsTest-969875148-project-member] Lock "46a52acb-8622-452c-824e-66494956c1d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.603s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.network.neutron [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Starting migrate_disk_and_power_off {{(pid=74880) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:01 user nova-compute[74880]: WARNING nova.compute.manager [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state active and task_state resize_migrating.
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:01 user nova-compute[74880]: WARNING nova.compute.manager [req-9f77bb14-5b12-4886-8a08-6b5f39e58837 req-13a6ccb7-b250-4c8f-8321-38916c0fec04 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state active and task_state resize_migrating.
Nov 15 01:22:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance destroyed successfully.
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fe814ba-5e, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e44ed7d-4c0f-44ca-bf04-668c9e57e3be) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: INFO os_vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e')
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:01 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9955eaa-087c-408c-a68e-a02d7afdaa1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:22:01 user nova-compute[74880]: No targets found.
Nov 15 01:22:01 user nova-compute[74880]: iSNS:
Nov 15 01:22:01 user nova-compute[74880]: No targets found.
Nov 15 01:22:01 user nova-compute[74880]: STATIC:
Nov 15 01:22:01 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:22:01 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:01 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:01 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:22:01 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:01 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:01 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:22:01 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:01 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:01 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c
Nov 15 01:22:01 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:01 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:01 user nova-compute[74880]: FIRMWARE:
Nov 15 01:22:01 user nova-compute[74880]: No targets found.
Nov 15 01:22:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:22:01 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:22:01 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a645c40-d3e7-4c52-a296-e2f49bf4cfd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[06928f64-7b7e-4d3a-80c3-404c6f5aa658]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:01 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:01 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:01 user nova-compute[74880]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:01 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:01 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:01 user nova-compute[74880]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f05ed090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19e8e9-431a-4a3c-94ff-0befc5afbf81]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75130d0-56c3-41ca-a309-907adb6efec5]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f940c62-a8ba-412d-8a7d-e60d61489033]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b3a08-d2af-4861-9e8c-b7a68467e372]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88137507-b99b-4d7b-abd5-17869d9c71e9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b5557-2b52-460f-b480-7e9568a195ed]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]
Nov 15 01:22:01 user nova-compute[74880]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.
Nov 15 01:22:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c15bd-6489-48a1-abc3-7fac4d103bf3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== disconnect_volume: return (310ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:22:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d_resize/disk /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "cp -r /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d_resize/disk /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk" returned: 0 in 0.567s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d_resize/disk.info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk.info {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "cp -r /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d_resize/disk.info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk.info" returned: 0 in 0.037s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Port 6fe814ba-5ec3-4038-9d2e-694980cd4ed3 binding to destination host user is already ACTIVE {{(pid=74880) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 01:22:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG nova.network.neutron [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG os_brick.utils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c7e883-d5a2-43cf-8df9-c6de4770a932]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9514d900-14de-49e6-9a89-d001c9e7f208]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e747c-f719-4038-a043-cd1886d22e21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[604b75dc-cbde-4228-ba36-869ae0c27495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:22:05 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:22:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b61a21-17a3-4256-a5bb-85141f94c6a4]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:22:05 user nova-compute[74880]: DEBUG os_brick.utils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:22:10 user nova-compute[74880]: INFO nova.compute.claims [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Claim successful on node user
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Starting finish_migration {{(pid=74880) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:22:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Creating image(s)
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk. size=21474836480 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:22:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.policy [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c88b23d691c4cdc98757d0af8ab27c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96e59bffc2b4c99940e4c87ad82521e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk 21474836480 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:22:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Creating image(s)
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk 21474836480" returned: 0 in 0.123s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Ensure instance console log exists: /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start _get_guest_xml network_info=[{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '00eda474-3fbc-45ce-8986-6e8cbb90bd2d', 'attached_at': '2023-11-15T01:22:10.000000', 'detached_at': '', 'volume_id': '1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'serial': '1ed8b916-c70c-4ec7-8424-efb9d161d7e9'}, 'mount_device': '/dev/vdb', 'attachment_id': '0abc3638-2f55-4935-bc23-0bf3aa93f823', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:22:10 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:10 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:22:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:11 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:11 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:11 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78657a56-0ece-477c-a8ba-a6cf3b102011]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:22:11 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02274890-5249-4317-8e7c-7cd596224654]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9] added
Nov 15 01:22:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5356ee-ddc3-4564-bf95-9e894ce9caf2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.214s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ff2557-a630-4323-99f1-24ddc8b0790f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzapVJQv {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzapVJQv" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c1c18d-c583-43b7-8192-26c54171d2f0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZzapVJQv'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d39a5-55e3-4412-a354-8ee73abe458d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f3e93-7a94-4d37-8835-3310a9c22aeb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[42492885-cde8-4741-856e-840bedc474d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]
Nov 15 01:22:11 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.
Nov 15 01:22:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21727de-355c-43c9-aa7f-242cf1246886]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk 1073741824" returned: 0 in 0.052s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427eb84-0cbe-4c34-8092-d8e1edac43c6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:11 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d5a719-e043-49d2-a711-184f687ecbc9]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.202s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Successfully created port: 95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Cannot resize image /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Ensure instance console log exists: /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Successfully updated port: 95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing instance network info cache due to event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26463616331346332', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463616331346332', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:22:12 user nova-compute[74880]:   <uuid>00eda474-3fbc-45ce-8986-6e8cbb90bd2d</uuid>
Nov 15 01:22:12 user nova-compute[74880]:   <name>instance-00000011</name>
Nov 15 01:22:12 user nova-compute[74880]:   <memory>2097152</memory>
Nov 15 01:22:12 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:22:12 user nova-compute[74880]:   <metadata>
Nov 15 01:22:12 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:22:12 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherB-server-1351279143</nova:name>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:22:10</nova:creationTime>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:flavor name="m1.small">
Nov 15 01:22:12 user nova-compute[74880]:         <nova:memory>2048</nova:memory>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:disk>20</nova:disk>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:22:12 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:owner>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:user uuid="baa7a9a3c7994818bee910e2bf0e6043">tempest-ServerActionsTestOtherB-230839994-project-member</nova:user>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:project uuid="b855ee7bc0e344ac836b02b1e86c3798">tempest-ServerActionsTestOtherB-230839994</nova:project>
Nov 15 01:22:12 user nova-compute[74880]:       </nova:owner>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:ports>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:port uuid="6fe814ba-5ec3-4038-9d2e-694980cd4ed3">
Nov 15 01:22:12 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:22:12 user nova-compute[74880]:         </nova:port>
Nov 15 01:22:12 user nova-compute[74880]:       </nova:ports>
Nov 15 01:22:12 user nova-compute[74880]:     </nova:instance>
Nov 15 01:22:12 user nova-compute[74880]:   </metadata>
Nov 15 01:22:12 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:22:12 user nova-compute[74880]:     <system>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="serial">00eda474-3fbc-45ce-8986-6e8cbb90bd2d</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="uuid">00eda474-3fbc-45ce-8986-6e8cbb90bd2d</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:22:12 user nova-compute[74880]:     </system>
Nov 15 01:22:12 user nova-compute[74880]:   </sysinfo>
Nov 15 01:22:12 user nova-compute[74880]:   <os>
Nov 15 01:22:12 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:22:12 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:22:12 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:22:12 user nova-compute[74880]:   </os>
Nov 15 01:22:12 user nova-compute[74880]:   <features>
Nov 15 01:22:12 user nova-compute[74880]:     <acpi/>
Nov 15 01:22:12 user nova-compute[74880]:     <apic/>
Nov 15 01:22:12 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:22:12 user nova-compute[74880]:   </features>
Nov 15 01:22:12 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:22:12 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:22:12 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:22:12 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:22:12 user nova-compute[74880]:   </clock>
Nov 15 01:22:12 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:22:12 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:22:12 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:22:12 user nova-compute[74880]:   </cpu>
Nov 15 01:22:12 user nova-compute[74880]:   <devices>
Nov 15 01:22:12 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:22:12 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:22:12 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk"/>
Nov 15 01:22:12 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:     </disk>
Nov 15 01:22:12 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:22:12 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:22:12 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:22:12 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:       <serial>1ed8b916-c70c-4ec7-8424-efb9d161d7e9</serial>
Nov 15 01:22:12 user nova-compute[74880]:     </disk>
Nov 15 01:22:12 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:22:12 user nova-compute[74880]:       <mac address="fa:16:3e:0f:db:87"/>
Nov 15 01:22:12 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:22:12 user nova-compute[74880]:       <target dev="tap6fe814ba-5e"/>
Nov 15 01:22:12 user nova-compute[74880]:     </interface>
Nov 15 01:22:12 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:22:12 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/console.log" append="off"/>
Nov 15 01:22:12 user nova-compute[74880]:     </serial>
Nov 15 01:22:12 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:22:12 user nova-compute[74880]:     <video>
Nov 15 01:22:12 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:     </video>
Nov 15 01:22:12 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:22:12 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:22:12 user nova-compute[74880]:     </rng>
Nov 15 01:22:12 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:22:12 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:22:12 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:22:12 user nova-compute[74880]:     </memballoon>
Nov 15 01:22:12 user nova-compute[74880]:   </devices>
Nov 15 01:22:12 user nova-compute[74880]: </domain>
Nov 15 01:22:12 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1867375276-network", "vif_mac": "fa:16:3e:0f:db:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG os_vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bece979d-ffd4-57dd-99bd-cdc91472098b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fe814ba-5e, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fe814ba-5e, col_values=(('qos', UUID('6aaf7fe9-384a-48fe-acbe-3fb2b87e2dae')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fe814ba-5e, col_values=(('external_ids', {'iface-id': '6fe814ba-5ec3-4038-9d2e-694980cd4ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:db:87', 'vm-uuid': '00eda474-3fbc-45ce-8986-6e8cbb90bd2d'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: INFO os_vif [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e')
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance network_info: |[{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Start _get_guest_xml network_info=[{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] No VIF found with MAC fa:16:3e:0f:db:87, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:22:12 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:12 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444318931',display_name='tempest-ServerRescueNegativeTestJSON-server-444318931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444318931',id=23,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8cAWldZA1oB9vFJmCXGl0c7Uog634wYXXB0/A8E9fmUE/jAvmYLSlo332qSqd2uSixKAYRepST8Ao+tynwuFe57rqk/0veuEXTnZz3p7CcgjAxs74+8a/znxsLx1WpPA==',key_name='tempest-keypair-1514010484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-30yyp7wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=88540810-db28-4f01-aa45-5cc4497214e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.objects.instance [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'pci_devices' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:22:12 user nova-compute[74880]:   <uuid>88540810-db28-4f01-aa45-5cc4497214e6</uuid>
Nov 15 01:22:12 user nova-compute[74880]:   <name>instance-00000017</name>
Nov 15 01:22:12 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:22:12 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:22:12 user nova-compute[74880]:   <metadata>
Nov 15 01:22:12 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:22:12 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-444318931</nova:name>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:22:12</nova:creationTime>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:22:12 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:22:12 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:owner>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:user uuid="7c88b23d691c4cdc98757d0af8ab27c1">tempest-ServerRescueNegativeTestJSON-1212122190-project-member</nova:user>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:project uuid="d96e59bffc2b4c99940e4c87ad82521e">tempest-ServerRescueNegativeTestJSON-1212122190</nova:project>
Nov 15 01:22:12 user nova-compute[74880]:       </nova:owner>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:22:12 user nova-compute[74880]:       <nova:ports>
Nov 15 01:22:12 user nova-compute[74880]:         <nova:port uuid="95133b7d-cd2d-44f6-a750-7354144aaf36">
Nov 15 01:22:12 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:22:12 user nova-compute[74880]:         </nova:port>
Nov 15 01:22:12 user nova-compute[74880]:       </nova:ports>
Nov 15 01:22:12 user nova-compute[74880]:     </nova:instance>
Nov 15 01:22:12 user nova-compute[74880]:   </metadata>
Nov 15 01:22:12 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:22:12 user nova-compute[74880]:     <system>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="serial">88540810-db28-4f01-aa45-5cc4497214e6</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="uuid">88540810-db28-4f01-aa45-5cc4497214e6</entry>
Nov 15 01:22:12 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:22:12 user nova-compute[74880]:     </system>
Nov 15 01:22:12 user nova-compute[74880]:   </sysinfo>
Nov 15 01:22:12 user nova-compute[74880]:   <os>
Nov 15 01:22:12 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:22:12 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:22:12 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:22:12 user nova-compute[74880]:   </os>
Nov 15 01:22:12 user nova-compute[74880]:   <features>
Nov 15 01:22:12 user nova-compute[74880]:     <acpi/>
Nov 15 01:22:12 user nova-compute[74880]:     <apic/>
Nov 15 01:22:12 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:22:12 user nova-compute[74880]:   </features>
Nov 15 01:22:12 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:22:12 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:22:12 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:22:12 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:22:12 user nova-compute[74880]:   </clock>
Nov 15 01:22:12 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:22:12 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:22:12 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:22:12 user nova-compute[74880]:   </cpu>
Nov 15 01:22:12 user nova-compute[74880]:   <devices>
Nov 15 01:22:12 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:22:12 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:22:12 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk"/>
Nov 15 01:22:12 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:     </disk>
Nov 15 01:22:12 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:22:12 user nova-compute[74880]:       <mac address="fa:16:3e:4a:23:14"/>
Nov 15 01:22:12 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:22:12 user nova-compute[74880]:       <target dev="tap95133b7d-cd"/>
Nov 15 01:22:12 user nova-compute[74880]:     </interface>
Nov 15 01:22:12 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:22:12 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/console.log" append="off"/>
Nov 15 01:22:12 user nova-compute[74880]:     </serial>
Nov 15 01:22:12 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:22:12 user nova-compute[74880]:     <video>
Nov 15 01:22:12 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:22:12 user nova-compute[74880]:     </video>
Nov 15 01:22:12 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:22:12 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:22:12 user nova-compute[74880]:     </rng>
Nov 15 01:22:12 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:22:12 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:22:12 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:22:12 user nova-compute[74880]:     </memballoon>
Nov 15 01:22:12 user nova-compute[74880]:   </devices>
Nov 15 01:22:12 user nova-compute[74880]: </domain>
Nov 15 01:22:12 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444318931',display_name='tempest-ServerRescueNegativeTestJSON-server-444318931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444318931',id=23,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8cAWldZA1oB9vFJmCXGl0c7Uog634wYXXB0/A8E9fmUE/jAvmYLSlo332qSqd2uSixKAYRepST8Ao+tynwuFe57rqk/0veuEXTnZz3p7CcgjAxs74+8a/znxsLx1WpPA==',key_name='tempest-keypair-1514010484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-30yyp7wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=88540810-db28-4f01-aa45-5cc4497214e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG os_vif [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cef5174a-f88b-5b0d-8332-5950309b54c6', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95133b7d-cd, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95133b7d-cd, col_values=(('qos', UUID('f161cae6-04a2-47c0-ab4f-38b29412b878')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95133b7d-cd, col_values=(('external_ids', {'iface-id': '95133b7d-cd2d-44f6-a750-7354144aaf36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:23:14', 'vm-uuid': '88540810-db28-4f01-aa45-5cc4497214e6'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:12 user nova-compute[74880]: INFO os_vif [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd')
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:4a:23:14, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updated VIF entry in instance network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG nova.network.neutron [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-918b262f-44fe-4d6e-9f58-05aa91927d42 req-5a15097e-b37d-4a1d-92d2-2bce93d05f32 service nova] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-f11ba59f-b822-4337-b71a-4346f880e3ea req-043283d6-2c22-43c3-8569-51769a025d54 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f11ba59f-b822-4337-b71a-4346f880e3ea req-043283d6-2c22-43c3-8569-51769a025d54 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f11ba59f-b822-4337-b71a-4346f880e3ea req-043283d6-2c22-43c3-8569-51769a025d54 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f11ba59f-b822-4337-b71a-4346f880e3ea req-043283d6-2c22-43c3-8569-51769a025d54 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-f11ba59f-b822-4337-b71a-4346f880e3ea req-043283d6-2c22-43c3-8569-51769a025d54 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:15 user nova-compute[74880]: WARNING nova.compute.manager [req-f11ba59f-b822-4337-b71a-4346f880e3ea req-043283d6-2c22-43c3-8569-51769a025d54 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state active and task_state resize_finish.
Nov 15 01:22:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-415281f0-9de5-40ab-888d-7519457a976e req-01bbf4ee-ec29-4b84-9b13-f8e3e29b68ed service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-415281f0-9de5-40ab-888d-7519457a976e req-01bbf4ee-ec29-4b84-9b13-f8e3e29b68ed service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-415281f0-9de5-40ab-888d-7519457a976e req-01bbf4ee-ec29-4b84-9b13-f8e3e29b68ed service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-415281f0-9de5-40ab-888d-7519457a976e req-01bbf4ee-ec29-4b84-9b13-f8e3e29b68ed service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-415281f0-9de5-40ab-888d-7519457a976e req-01bbf4ee-ec29-4b84-9b13-f8e3e29b68ed service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:15 user nova-compute[74880]: WARNING nova.compute.manager [req-415281f0-9de5-40ab-888d-7519457a976e req-01bbf4ee-ec29-4b84-9b13-f8e3e29b68ed service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state building and task_state spawning.
Nov 15 01:22:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-d2ada8b0-bb1d-4275-9a3b-0c202eb6fa6b req-cc45ddb5-59e4-427b-82bd-7ef462ab371c service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d2ada8b0-bb1d-4275-9a3b-0c202eb6fa6b req-cc45ddb5-59e4-427b-82bd-7ef462ab371c service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d2ada8b0-bb1d-4275-9a3b-0c202eb6fa6b req-cc45ddb5-59e4-427b-82bd-7ef462ab371c service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d2ada8b0-bb1d-4275-9a3b-0c202eb6fa6b req-cc45ddb5-59e4-427b-82bd-7ef462ab371c service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-d2ada8b0-bb1d-4275-9a3b-0c202eb6fa6b req-cc45ddb5-59e4-427b-82bd-7ef462ab371c service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:17 user nova-compute[74880]: WARNING nova.compute.manager [req-d2ada8b0-bb1d-4275-9a3b-0c202eb6fa6b req-cc45ddb5-59e4-427b-82bd-7ef462ab371c service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state active and task_state resize_finish.
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-7bb03032-2b9f-4540-a357-895236e98ef1 req-c19a0b36-4794-4873-a6c6-52260af044d1 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7bb03032-2b9f-4540-a357-895236e98ef1 req-c19a0b36-4794-4873-a6c6-52260af044d1 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7bb03032-2b9f-4540-a357-895236e98ef1 req-c19a0b36-4794-4873-a6c6-52260af044d1 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7bb03032-2b9f-4540-a357-895236e98ef1 req-c19a0b36-4794-4873-a6c6-52260af044d1 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-7bb03032-2b9f-4540-a357-895236e98ef1 req-c19a0b36-4794-4873-a6c6-52260af044d1 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:17 user nova-compute[74880]: WARNING nova.compute.manager [req-7bb03032-2b9f-4540-a357-895236e98ef1 req-c19a0b36-4794-4873-a6c6-52260af044d1 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state building and task_state spawning.
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:22:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance running successfully.
Nov 15 01:22:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance spawned successfully.
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Failed to set time: agent not configured {{(pid=74880) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-98ad7ed6-1e40-462c-af46-2f19e7de801c tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] finish_migration finished successfully. {{(pid=74880) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:17 user nova-compute[74880]: INFO nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 15 01:22:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:22:17 user nova-compute[74880]: INFO nova.compute.manager [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Took 7.80 seconds to build instance.
Nov 15 01:22:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-35fced9d-4ae0-4aa0-af4e-66d0518c4e67 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.923s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:19 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55e471a1-d95f-43c0-a3fc-fb6454202253 is timed out.
Nov 15 01:22:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully detached device vdb from instance 55e471a1-d95f-43c0-a3fc-fb6454202253 from the live domain config.
Nov 15 01:22:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQcoVrAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:19 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3e2a85-8b7f-41d1-8440-e2fbb46e74c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:22:19 user nova-compute[74880]: No targets found.
Nov 15 01:22:19 user nova-compute[74880]: iSNS:
Nov 15 01:22:19 user nova-compute[74880]: No targets found.
Nov 15 01:22:19 user nova-compute[74880]: STATIC:
Nov 15 01:22:19 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:22:19 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:19 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:19 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:22:19 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:19 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:19 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:22:19 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:19 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:19 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c
Nov 15 01:22:19 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:19 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:19 user nova-compute[74880]: FIRMWARE:
Nov 15 01:22:19 user nova-compute[74880]: No targets found.
Nov 15 01:22:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:22:19 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:22:19 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e128766-3550-421a-b641-5dd926d5919a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[533e409e-2976-445d-8322-2fb800076267]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:19 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:19 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:19 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:19 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:19 user nova-compute[74880]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c (non-flash)
Nov 15 01:22:19 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:19 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9513dcf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c'): ({'sde'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Removing single pathed devices sde {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5037954-d2d8-4f8b-a53d-05380908c5dd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[27753546-d70f-42ba-8e56-9964fcc3017b]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Flushing IO for device /dev/sde {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2fd41b-7c3f-4dc0-b72b-ffb2b10ac820]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefdb113-069f-4a63-829b-810170cf7c06]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1159220-8fe0-41fe-b448-438c8103b080]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:20 user nova-compute[74880]: INFO nova.compute.manager [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Terminating instance
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420974d-f13d-40ca-8c3b-0a87ea870a88]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260]
Nov 15 01:22:20 user nova-compute[74880]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c, portal: 172.16.0.220,3260] successful.
Nov 15 01:22:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d620d241-c860-458d-b32f-67f540d085dc]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== disconnect_volume: return (345ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-42197506-06ec-47c4-9678-88a36d92bbca req-51cbdec2-d595-473b-9716-f59576c7a760 service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-vif-unplugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42197506-06ec-47c4-9678-88a36d92bbca req-51cbdec2-d595-473b-9716-f59576c7a760 service nova] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42197506-06ec-47c4-9678-88a36d92bbca req-51cbdec2-d595-473b-9716-f59576c7a760 service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-42197506-06ec-47c4-9678-88a36d92bbca req-51cbdec2-d595-473b-9716-f59576c7a760 service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-42197506-06ec-47c4-9678-88a36d92bbca req-51cbdec2-d595-473b-9716-f59576c7a760 service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] No waiting events found dispatching network-vif-unplugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-42197506-06ec-47c4-9678-88a36d92bbca req-51cbdec2-d595-473b-9716-f59576c7a760 service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-vif-unplugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:22:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Instance destroyed successfully.
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lazy-loading 'resources' on Instance uuid 2727cc6a-7997-41e6-aaa1-39bce8afdee1 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248536215',display_name='tempest-ServersNegativeTestJSON-server-248536215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248536215',id=3,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b89fc20cea474b93164a63cbc4c3e4',ramdisk_id='',reservation_id='r-azwpgb1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1657617311',owner_user_name='tempest-ServersNegativeTestJSON-1657617311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:13:55Z,user_data=None,user_id='9de13732bcf04ab98686accb51cd4af4',uuid=2727cc6a-7997-41e6-aaa1-39bce8afdee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converting VIF {"id": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "address": "fa:16:3e:11:23:c3", "network": {"id": "6961bf4a-a9e9-4422-9d17-f88c4f10bc96", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-824779402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b89fc20cea474b93164a63cbc4c3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e13360-c3", "ovs_interfaceid": "d3e13360-c31b-407b-9c14-2d1e76d74e46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG os_vif [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3e13360-c3, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'flavor' on Instance uuid 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=878170bf-59ac-463b-a563-3c041d052406) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:20 user nova-compute[74880]: INFO os_vif [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:23:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3e13360-c31b-407b-9c14-2d1e76d74e46,network=Network(6961bf4a-a9e9-4422-9d17-f88c4f10bc96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e13360-c3')
Nov 15 01:22:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Deleting instance files /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1_del
Nov 15 01:22:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Deletion of /opt/stack/data/nova/instances/2727cc6a-7997-41e6-aaa1-39bce8afdee1_del complete
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a6c1171-a71b-4913-b24f-8a4af4fead77 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.876s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.785s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:20 user nova-compute[74880]: INFO nova.compute.manager [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Terminating instance
Nov 15 01:22:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:22:21 user nova-compute[74880]: INFO nova.compute.manager [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Instance destroyed successfully.
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'resources' on Instance uuid 55e471a1-d95f-43c0-a3fc-fb6454202253 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-811473836',display_name='tempest-VolumesSnapshotTestJSON-instance-811473836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-811473836',id=19,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmlpztN5z9UT6e0A+pbyxLmjgHnvPz/LbO714v8il3uHb9gTGWUeKVHqYJcgLe+ftNK/TursTNoo5jbQ25rvd2Ex9rC30UxW38UvDzyek6e6GEdMRAxCEPxjL+p7AnQiA==',key_name='tempest-keypair-1509311259',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:19:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fb3f3931294909bfc88b6569034b6d',ramdisk_id='',reservation_id='r-cggby9jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-648990630',owner_user_name='tempest-VolumesSnapshotTestJSON-648990630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2750a138414933b47db189a233aaed',uuid=55e471a1-d95f-43c0-a3fc-fb6454202253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converting VIF {"id": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "address": "fa:16:3e:3d:d7:09", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dee47f9-fe", "ovs_interfaceid": "5dee47f9-fe9c-485c-bebf-2a38127bfe29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_vif [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dee47f9-fe, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e60caf04-5ecd-42da-9846-51a8cb84dfa5) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:21 user nova-compute[74880]: INFO os_vif [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:d7:09,bridge_name='br-int',has_traffic_filtering=True,id=5dee47f9-fe9c-485c-bebf-2a38127bfe29,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dee47f9-fe')
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQcoVrAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:21 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8783a-5bf2-46fb-b908-17a4c39cfe34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:22:21 user nova-compute[74880]: No targets found.
Nov 15 01:22:21 user nova-compute[74880]: iSNS:
Nov 15 01:22:21 user nova-compute[74880]: No targets found.
Nov 15 01:22:21 user nova-compute[74880]: STATIC:
Nov 15 01:22:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:22:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:22:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:22:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:21 user nova-compute[74880]: FIRMWARE:
Nov 15 01:22:21 user nova-compute[74880]: No targets found.
Nov 15 01:22:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:22:21 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:22:21 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ff12f5-c053-45c0-b032-4af5541dae2c', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bda6abd-f8be-48b2-8d4f-d4dded4168a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b030eb-5dfb-4c7e-87fb-f7ff38e1b73a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:21 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:21 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:21 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:21 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f07a43a0>, {}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Disconnecting from: [] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== disconnect_volume: return (84ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:22:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Deleting instance files /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253_del
Nov 15 01:22:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Deletion of /opt/stack/data/nova/instances/55e471a1-d95f-43c0-a3fc-fb6454202253_del complete
Nov 15 01:22:22 user nova-compute[74880]: INFO nova.compute.manager [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:22 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Took 1.07 seconds to deallocate network for instance.
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] Acquiring lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] No waiting events found dispatching network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:22 user nova-compute[74880]: WARNING nova.compute.manager [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received unexpected event network-vif-plugged-d3e13360-c31b-407b-9c14-2d1e76d74e46 for instance with vm_state deleted and task_state None.
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-7368defd-cceb-49fd-8526-860ed5b2a3a9 req-a0d6c42c-56db-44ab-ae5a-f634cfb666ed service nova] [instance: 2727cc6a-7997-41e6-aaa1-39bce8afdee1] Received event network-vif-deleted-d3e13360-c31b-407b-9c14-2d1e76d74e46 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:22 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Deleted allocations for instance 2727cc6a-7997-41e6-aaa1-39bce8afdee1
Nov 15 01:22:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e1a2bfe-0086-4c28-8288-e15a2ca45304 tempest-ServersNegativeTestJSON-1657617311 tempest-ServersNegativeTestJSON-1657617311-project-member] Lock "2727cc6a-7997-41e6-aaa1-39bce8afdee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-c4c03679-65b3-41ff-948c-c23c213368c0 req-82e94568-f0d0-463b-8e7a-038b41e3679e service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-vif-unplugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c4c03679-65b3-41ff-948c-c23c213368c0 req-82e94568-f0d0-463b-8e7a-038b41e3679e service nova] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c4c03679-65b3-41ff-948c-c23c213368c0 req-82e94568-f0d0-463b-8e7a-038b41e3679e service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c4c03679-65b3-41ff-948c-c23c213368c0 req-82e94568-f0d0-463b-8e7a-038b41e3679e service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-c4c03679-65b3-41ff-948c-c23c213368c0 req-82e94568-f0d0-463b-8e7a-038b41e3679e service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] No waiting events found dispatching network-vif-unplugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-c4c03679-65b3-41ff-948c-c23c213368c0 req-82e94568-f0d0-463b-8e7a-038b41e3679e service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-vif-unplugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:22:24 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:24 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Took 2.23 seconds to deallocate network for instance.
Nov 15 01:22:24 user nova-compute[74880]: WARNING nova.volume.cinder [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Attachment 725b75b8-ca3c-4875-89b7-04a4de698413 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 725b75b8-ca3c-4875-89b7-04a4de698413. (HTTP 404) (Request-ID: req-8918d16c-52f4-4951-b11f-7b25dc046f3e)
Nov 15 01:22:24 user nova-compute[74880]: INFO nova.compute.manager [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 01:22:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b35b9e6-c99e-4228-a416-c2b632d26d2a req-d14310e0-8ee5-4111-b203-28d6f8fdf134 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-vif-deleted-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:24 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:24 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:24 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Deleted allocations for instance 55e471a1-d95f-43c0-a3fc-fb6454202253
Nov 15 01:22:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9bee4ab-da06-4ddd-8a5b-53dcfa494d10 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.873s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:22:25 user nova-compute[74880]: INFO nova.compute.claims [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Claim successful on node user
Nov 15 01:22:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-3c1a5757-0485-406c-8b1e-eb96e0e9a406 req-7adfb80d-5330-45f6-bfb5-dc5d6174f1a8 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received event network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3c1a5757-0485-406c-8b1e-eb96e0e9a406 req-7adfb80d-5330-45f6-bfb5-dc5d6174f1a8 service nova] Acquiring lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3c1a5757-0485-406c-8b1e-eb96e0e9a406 req-7adfb80d-5330-45f6-bfb5-dc5d6174f1a8 service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3c1a5757-0485-406c-8b1e-eb96e0e9a406 req-7adfb80d-5330-45f6-bfb5-dc5d6174f1a8 service nova] Lock "55e471a1-d95f-43c0-a3fc-fb6454202253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-3c1a5757-0485-406c-8b1e-eb96e0e9a406 req-7adfb80d-5330-45f6-bfb5-dc5d6174f1a8 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] No waiting events found dispatching network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:25 user nova-compute[74880]: WARNING nova.compute.manager [req-3c1a5757-0485-406c-8b1e-eb96e0e9a406 req-7adfb80d-5330-45f6-bfb5-dc5d6174f1a8 service nova] [instance: 55e471a1-d95f-43c0-a3fc-fb6454202253] Received unexpected event network-vif-plugged-5dee47f9-fe9c-485c-bebf-2a38127bfe29 for instance with vm_state deleted and task_state None.
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.network.neutron [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:22:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.policy [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8105ea094961417982de5311ecff7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9227eed50873467fa2d81608d5f77978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:22:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Creating image(s)
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "/opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "/opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.261s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk 1073741824" returned: 0 in 0.091s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.network.neutron [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Successfully created port: aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Cannot resize image /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.network.neutron [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Successfully updated port: aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "refresh_cache-1fc1c56b-bf28-4060-80c8-1552e2632bdd" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquired lock "refresh_cache-1fc1c56b-bf28-4060-80c8-1552e2632bdd" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.network.neutron [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-changed-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Refreshing instance network info cache due to event network-changed-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] Acquiring lock "refresh_cache-1fc1c56b-bf28-4060-80c8-1552e2632bdd" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:27 user nova-compute[74880]: DEBUG nova.network.neutron [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Updating instance_info_cache with network_info: [{"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Releasing lock "refresh_cache-1fc1c56b-bf28-4060-80c8-1552e2632bdd" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Instance network_info: |[{"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] Acquired lock "refresh_cache-1fc1c56b-bf28-4060-80c8-1552e2632bdd" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.neutron [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Refreshing network info cache for port aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Start _get_guest_xml network_info=[{"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:22:28 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:28 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-660748554',display_name='tempest-VolumesActionsTest-instance-660748554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-660748554',id=24,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9227eed50873467fa2d81608d5f77978',ramdisk_id='',reservation_id='r-qm45qkxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-565390894',owner_user_name='tempest-VolumesActionsTest-565390894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:26Z,user_data=None,user_id='8105ea094961417982de5311ecff7635',uuid=1fc1c56b-bf28-4060-80c8-1552e2632bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converting VIF {"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.objects.instance [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc1c56b-bf28-4060-80c8-1552e2632bdd {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:22:28 user nova-compute[74880]:   <uuid>1fc1c56b-bf28-4060-80c8-1552e2632bdd</uuid>
Nov 15 01:22:28 user nova-compute[74880]:   <name>instance-00000018</name>
Nov 15 01:22:28 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:22:28 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:22:28 user nova-compute[74880]:   <metadata>
Nov 15 01:22:28 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:22:28 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:22:28 user nova-compute[74880]:       <nova:name>tempest-VolumesActionsTest-instance-660748554</nova:name>
Nov 15 01:22:28 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:22:28</nova:creationTime>
Nov 15 01:22:28 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:22:28 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:22:28 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:22:28 user nova-compute[74880]:       <nova:owner>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:user uuid="8105ea094961417982de5311ecff7635">tempest-VolumesActionsTest-565390894-project-member</nova:user>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:project uuid="9227eed50873467fa2d81608d5f77978">tempest-VolumesActionsTest-565390894</nova:project>
Nov 15 01:22:28 user nova-compute[74880]:       </nova:owner>
Nov 15 01:22:28 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:22:28 user nova-compute[74880]:       <nova:ports>
Nov 15 01:22:28 user nova-compute[74880]:         <nova:port uuid="aebe45dd-d4eb-423a-a29d-df6a5e55d0a4">
Nov 15 01:22:28 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 01:22:28 user nova-compute[74880]:         </nova:port>
Nov 15 01:22:28 user nova-compute[74880]:       </nova:ports>
Nov 15 01:22:28 user nova-compute[74880]:     </nova:instance>
Nov 15 01:22:28 user nova-compute[74880]:   </metadata>
Nov 15 01:22:28 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:22:28 user nova-compute[74880]:     <system>
Nov 15 01:22:28 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:22:28 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:22:28 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:22:28 user nova-compute[74880]:       <entry name="serial">1fc1c56b-bf28-4060-80c8-1552e2632bdd</entry>
Nov 15 01:22:28 user nova-compute[74880]:       <entry name="uuid">1fc1c56b-bf28-4060-80c8-1552e2632bdd</entry>
Nov 15 01:22:28 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:22:28 user nova-compute[74880]:     </system>
Nov 15 01:22:28 user nova-compute[74880]:   </sysinfo>
Nov 15 01:22:28 user nova-compute[74880]:   <os>
Nov 15 01:22:28 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:22:28 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:22:28 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:22:28 user nova-compute[74880]:   </os>
Nov 15 01:22:28 user nova-compute[74880]:   <features>
Nov 15 01:22:28 user nova-compute[74880]:     <acpi/>
Nov 15 01:22:28 user nova-compute[74880]:     <apic/>
Nov 15 01:22:28 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:22:28 user nova-compute[74880]:   </features>
Nov 15 01:22:28 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:22:28 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:22:28 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:22:28 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:22:28 user nova-compute[74880]:   </clock>
Nov 15 01:22:28 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:22:28 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:22:28 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:22:28 user nova-compute[74880]:   </cpu>
Nov 15 01:22:28 user nova-compute[74880]:   <devices>
Nov 15 01:22:28 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:22:28 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:22:28 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk"/>
Nov 15 01:22:28 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:22:28 user nova-compute[74880]:     </disk>
Nov 15 01:22:28 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:22:28 user nova-compute[74880]:       <mac address="fa:16:3e:90:2a:7e"/>
Nov 15 01:22:28 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:22:28 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:22:28 user nova-compute[74880]:       <target dev="tapaebe45dd-d4"/>
Nov 15 01:22:28 user nova-compute[74880]:     </interface>
Nov 15 01:22:28 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:22:28 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/console.log" append="off"/>
Nov 15 01:22:28 user nova-compute[74880]:     </serial>
Nov 15 01:22:28 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:22:28 user nova-compute[74880]:     <video>
Nov 15 01:22:28 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:22:28 user nova-compute[74880]:     </video>
Nov 15 01:22:28 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:22:28 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:22:28 user nova-compute[74880]:     </rng>
Nov 15 01:22:28 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:22:28 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:22:28 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:22:28 user nova-compute[74880]:     </memballoon>
Nov 15 01:22:28 user nova-compute[74880]:   </devices>
Nov 15 01:22:28 user nova-compute[74880]: </domain>
Nov 15 01:22:28 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-660748554',display_name='tempest-VolumesActionsTest-instance-660748554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-660748554',id=24,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9227eed50873467fa2d81608d5f77978',ramdisk_id='',reservation_id='r-qm45qkxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-565390894',owner_user_name='tempest-VolumesActionsTest-565390894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:26Z,user_data=None,user_id='8105ea094961417982de5311ecff7635',uuid=1fc1c56b-bf28-4060-80c8-1552e2632bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converting VIF {"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG os_vif [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3273906-7c15-5c89-81c9-2f3935ea1483', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaebe45dd-d4, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaebe45dd-d4, col_values=(('qos', UUID('6852ef77-5381-4153-8b09-c1446eff568c')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaebe45dd-d4, col_values=(('external_ids', {'iface-id': 'aebe45dd-d4eb-423a-a29d-df6a5e55d0a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:2a:7e', 'vm-uuid': '1fc1c56b-bf28-4060-80c8-1552e2632bdd'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:28 user nova-compute[74880]: INFO os_vif [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4')
Nov 15 01:22:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] No VIF found with MAC fa:16:3e:90:2a:7e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:22:28 user nova-compute[74880]: INFO nova.compute.manager [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Detaching volume 7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:22:28 user nova-compute[74880]: INFO nova.virt.block_device [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Attempting to driver detach volume 7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 from mountpoint /dev/vdb
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Attempting to detach device vdb from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:22:28 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:22:28 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:22:28 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:22:28 user nova-compute[74880]:   <serial>7582a01c-3ca7-4c69-8ba4-bdd89cac6c12</serial>
Nov 15 01:22:28 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:22:28 user nova-compute[74880]: </disk>
Nov 15 01:22:28 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:22:28 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully detached device vdb from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e from the persistent domain config.
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:22:28 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:22:28 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:22:28 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:22:28 user nova-compute[74880]:   <serial>7582a01c-3ca7-4c69-8ba4-bdd89cac6c12</serial>
Nov 15 01:22:28 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:22:28 user nova-compute[74880]: </disk>
Nov 15 01:22:28 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.neutron [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Updated VIF entry in instance network info cache for port aebe45dd-d4eb-423a-a29d-df6a5e55d0a4. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG nova.network.neutron [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Updating instance_info_cache with network_info: [{"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09161db7-1d54-4689-bf17-fdde2873b21e req-d098d869-923e-42fd-90cd-6adfe8b1ae52 service nova] Releasing lock "refresh_cache-1fc1c56b-bf28-4060-80c8-1552e2632bdd" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:22:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e7c9b40-967a-4c7d-adf4-c1048f944fea req-aab6ef78-5783-4da7-a837-6c989f70603c service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e7c9b40-967a-4c7d-adf4-c1048f944fea req-aab6ef78-5783-4da7-a837-6c989f70603c service nova] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e7c9b40-967a-4c7d-adf4-c1048f944fea req-aab6ef78-5783-4da7-a837-6c989f70603c service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e7c9b40-967a-4c7d-adf4-c1048f944fea req-aab6ef78-5783-4da7-a837-6c989f70603c service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e7c9b40-967a-4c7d-adf4-c1048f944fea req-aab6ef78-5783-4da7-a837-6c989f70603c service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] No waiting events found dispatching network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:30 user nova-compute[74880]: WARNING nova.compute.manager [req-4e7c9b40-967a-4c7d-adf4-c1048f944fea req-aab6ef78-5783-4da7-a837-6c989f70603c service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received unexpected event network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 for instance with vm_state building and task_state spawning.
Nov 15 01:22:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-85b41631-d948-4ad7-99c6-04e9007e9b3f req-6305c209-00d0-4bd4-8002-15746271a2f6 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-85b41631-d948-4ad7-99c6-04e9007e9b3f req-6305c209-00d0-4bd4-8002-15746271a2f6 service nova] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-85b41631-d948-4ad7-99c6-04e9007e9b3f req-6305c209-00d0-4bd4-8002-15746271a2f6 service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-85b41631-d948-4ad7-99c6-04e9007e9b3f req-6305c209-00d0-4bd4-8002-15746271a2f6 service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-85b41631-d948-4ad7-99c6-04e9007e9b3f req-6305c209-00d0-4bd4-8002-15746271a2f6 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] No waiting events found dispatching network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:32 user nova-compute[74880]: WARNING nova.compute.manager [req-85b41631-d948-4ad7-99c6-04e9007e9b3f req-6305c209-00d0-4bd4-8002-15746271a2f6 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received unexpected event network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 for instance with vm_state building and task_state spawning.
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:22:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Instance spawned successfully.
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:22:32 user nova-compute[74880]: INFO nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 15 01:22:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:22:32 user nova-compute[74880]: INFO nova.compute.manager [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Took 6.98 seconds to build instance.
Nov 15 01:22:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-39eb4230-899b-4f41-8e8d-2d7541833e9a tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.062s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:40 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:22:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:43 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:22:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:46 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:46 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7343MB free_disk=25.532379150390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Applying migration context for instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d as it has an incoming, in-progress migration 112272ae-b8e1-460b-a20e-0623a226c748. Migration status is finished {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 01:22:46 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating resource usage from migration 112272ae-b8e1-460b-a20e-0623a226c748
Nov 15 01:22:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Migration 112272ae-b8e1-460b-a20e-0623a226c748 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 88540810-db28-4f01-aa45-5cc4497214e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 1fc1c56b-bf28-4060-80c8-1552e2632bdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:22:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:22:47 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:22:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:22:47 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:22:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:22:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:22:49 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e is timed out.
Nov 15 01:22:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully detached device vdb from instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e from the live domain config.
Nov 15 01:22:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaSJHFgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521da86-416b-4509-bf74-b5e002d346a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:22:49 user nova-compute[74880]: No targets found.
Nov 15 01:22:49 user nova-compute[74880]: iSNS:
Nov 15 01:22:49 user nova-compute[74880]: No targets found.
Nov 15 01:22:49 user nova-compute[74880]: STATIC:
Nov 15 01:22:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:22:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:22:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12
Nov 15 01:22:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:49 user nova-compute[74880]: FIRMWARE:
Nov 15 01:22:49 user nova-compute[74880]: No targets found.
Nov 15 01:22:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:22:49 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:22:49 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c7f0f1-20d6-4684-ab27-78c3a6a0941b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d044429b-a801-4fca-b4b5-d9d80974afcc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:49 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:49 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 (non-flash)
Nov 15 01:22:49 user nova-compute[74880]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:49 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f950818a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fc1edd-63a4-4f70-b6c5-56e7d3f21d09]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5188b4e7-50c1-42d5-94f6-3b64949bee6f]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea353127-4e12-4106-8168-e97d533ec7ae]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed01d2-9cf3-489d-bea0-112bea8bc85b]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[647bcba5-c6ce-4ec4-a653-a46ec5c1915a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[618bf1a6-5dd7-4f18-93af-f86bc89e1053]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260]
Nov 15 01:22:49 user nova-compute[74880]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12, portal: 172.16.0.220,3260] successful.
Nov 15 01:22:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7582a01c-3ca7-4c69-8ba4-bdd89cac6c12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6f54b1-1793-425b-b95d-063edefc9e10]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== disconnect_volume: return (331ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-changed-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Refreshing instance network info cache due to event network-changed-c826f62f-3a02-45e7-b066-392cbd32014e. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] Acquiring lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] Acquired lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Refreshing network info cache for port c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'flavor' on Instance uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2994fcad-4b36-47b2-850f-0f22327d415f tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.522s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updated VIF entry in instance network info cache for port c826f62f-3a02-45e7-b066-392cbd32014e. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG nova.network.neutron [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updating instance_info_cache with network_info: [{"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:22:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d9d12877-8b60-410c-8285-c65074269297 req-ff1bd7f4-c3cf-4590-9240-617aba7b5213 service nova] Releasing lock "refresh_cache-2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:22:51 user nova-compute[74880]: INFO nova.compute.manager [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Rebuilding instance
Nov 15 01:22:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:22:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance destroyed successfully.
Nov 15 01:22:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance destroyed successfully.
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312268747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-384987413',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMcAk9YFgMHc5QC18Zrh41amlCdbanvex0qu/dL79E4oEGET1gLpaDiVdfhJa9wrX/Cm9tleeuTYssjuZ3UjVPqkNb14qffQW15yrfOVUo9LgIFTkjeN4+fRuz5u+VKkA==',key_name='tempest-keypair-1641009201',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7eda993e255245fcbfe4e3044fbe51ce',ramdisk_id='',reservation_id='r-gi0obfpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-867042238',owner_user_name='tempest-ServerActionsV293TestJSON-867042238-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d027731a44c4b4eafba314166bd6006',uuid=2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converting VIF {"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc826f62f-3a, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=659dd42b-138b-49fc-b17f-41a89f2cb819) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:52 user nova-compute[74880]: INFO os_vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a')
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:52 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9fb638-7d70-4a30-ac9b-18af5bb90460]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:22:52 user nova-compute[74880]: No targets found.
Nov 15 01:22:52 user nova-compute[74880]: iSNS:
Nov 15 01:22:52 user nova-compute[74880]: No targets found.
Nov 15 01:22:52 user nova-compute[74880]: STATIC:
Nov 15 01:22:52 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:22:52 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:52 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:52 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:22:52 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:52 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:52 user nova-compute[74880]: FIRMWARE:
Nov 15 01:22:52 user nova-compute[74880]: No targets found.
Nov 15 01:22:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:22:52 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:22:52 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[444fd33b-1564-477d-aeb3-8f172eda8ea8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f950cd07-7067-4794-adf1-23755e73a6e3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:52 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:22:52 user nova-compute[74880]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d07a2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-unplugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-unplugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:52 user nova-compute[74880]: WARNING nova.compute.manager [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-unplugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state active and task_state rebuilding.
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:22:52 user nova-compute[74880]: WARNING nova.compute.manager [req-c8a47864-eff9-4017-9166-0c3ccdf1e9a6 req-2faf0dab-60df-4842-9fdc-4caa0b434606 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state active and task_state rebuilding.
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[805fb7e7-6b4f-4716-acde-2b28bf7f640e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[009e4882-9597-4671-8599-c07beaefe248]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fdd494-4339-411a-a945-4b436acf561d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2f3ce8-10ca-4d9d-958f-4f91fda52659]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4ed364fc-f472d20d2054df38', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ed364fc', '/dev/disk/by-id/scsi-26634373264323064') {{(pid=85948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fd3b1f-9d94-4562-aa37-2d6d1d964e97]: (4, None) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5331a1-f4e2-491f-b59a-5615103fdd6c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb007ea-9109-4357-96a8-b058c5c96e03]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]
Nov 15 01:22:52 user nova-compute[74880]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.
Nov 15 01:22:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f7ae6-0c24-4686-b2fc-f52104ac57fe]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== disconnect_volume: return (335ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:22:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Deleting instance files /opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f_del
Nov 15 01:22:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Deletion of /opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f_del complete
Nov 15 01:22:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f could not be found.
Nov 15 01:22:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:22:53 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18468887-5f1c-4fb9-b863-71fbd4acf5c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:22:53 user nova-compute[74880]: No targets found.
Nov 15 01:22:53 user nova-compute[74880]: iSNS:
Nov 15 01:22:53 user nova-compute[74880]: No targets found.
Nov 15 01:22:53 user nova-compute[74880]: STATIC:
Nov 15 01:22:53 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:22:53 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:22:53 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:22:53 user nova-compute[74880]: FIRMWARE:
Nov 15 01:22:53 user nova-compute[74880]: No targets found.
Nov 15 01:22:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:22:53 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:22:53 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b0ca0-6182-42d1-b04f-69fc4b8aac5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299cafb-9f15-48d8-bcda-60600f770ed0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:22:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f95138e2560>, {}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Disconnecting from: [] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== disconnect_volume: return (70ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Preparing to wait for external event volume-reimaged-c666dcc3-5e17-4d17-9705-7380b3794086 {{(pid=74880) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:22:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:22:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:22:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:23:01 user nova-compute[74880]: INFO nova.compute.claims [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Claim successful on node user
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:23:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.policy [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f2750a138414933b47db189a233aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fb3f3931294909bfc88b6569034b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:23:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Creating image(s)
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "/opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "/opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk 1073741824" returned: 0 in 0.046s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Successfully created port: 8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Cannot resize image /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Ensure instance console log exists: /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Successfully updated port: 8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquired lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-changed-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Refreshing instance network info cache due to event network-changed-8d49b499-57bd-4d6e-a446-5cf63617047d. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] Acquiring lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updating instance_info_cache with network_info: [{"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Releasing lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Instance network_info: |[{"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] Acquired lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Refreshing network info cache for port 8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Start _get_guest_xml network_info=[{"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:23:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-797180028',display_name='tempest-VolumesSnapshotTestJSON-instance-797180028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-797180028',id=25,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDEvXxmEWpIK9aFTrRG2prxiJaujDbb8xlBv+hIJLgDJdNawjN20M/kn3MxdHrFRsj7FR2pXVlcrqeBy0cnifF4xdYXIWfnqFtMpEFxuUZ8UHtTjymTrzYA8htcOYi4Cw==',key_name='tempest-keypair-247033617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb3f3931294909bfc88b6569034b6d',ramdisk_id='',reservation_id='r-m2agh3in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-648990630',owner_user_name='tempest-VolumesSnapshotTestJSON-648990630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2750a138414933b47db189a233aaed',uuid=3a37e5f8-0c79-4a15-bef1-43a12b7b8770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converting VIF {"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:23:04 user nova-compute[74880]:   <uuid>3a37e5f8-0c79-4a15-bef1-43a12b7b8770</uuid>
Nov 15 01:23:04 user nova-compute[74880]:   <name>instance-00000019</name>
Nov 15 01:23:04 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:23:04 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:23:04 user nova-compute[74880]:   <metadata>
Nov 15 01:23:04 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:23:04 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:23:04 user nova-compute[74880]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-797180028</nova:name>
Nov 15 01:23:04 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:23:04</nova:creationTime>
Nov 15 01:23:04 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:23:04 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:23:04 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:23:04 user nova-compute[74880]:       <nova:owner>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:user uuid="0f2750a138414933b47db189a233aaed">tempest-VolumesSnapshotTestJSON-648990630-project-member</nova:user>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:project uuid="c6fb3f3931294909bfc88b6569034b6d">tempest-VolumesSnapshotTestJSON-648990630</nova:project>
Nov 15 01:23:04 user nova-compute[74880]:       </nova:owner>
Nov 15 01:23:04 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:23:04 user nova-compute[74880]:       <nova:ports>
Nov 15 01:23:04 user nova-compute[74880]:         <nova:port uuid="8d49b499-57bd-4d6e-a446-5cf63617047d">
Nov 15 01:23:04 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 01:23:04 user nova-compute[74880]:         </nova:port>
Nov 15 01:23:04 user nova-compute[74880]:       </nova:ports>
Nov 15 01:23:04 user nova-compute[74880]:     </nova:instance>
Nov 15 01:23:04 user nova-compute[74880]:   </metadata>
Nov 15 01:23:04 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:23:04 user nova-compute[74880]:     <system>
Nov 15 01:23:04 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:23:04 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:23:04 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:23:04 user nova-compute[74880]:       <entry name="serial">3a37e5f8-0c79-4a15-bef1-43a12b7b8770</entry>
Nov 15 01:23:04 user nova-compute[74880]:       <entry name="uuid">3a37e5f8-0c79-4a15-bef1-43a12b7b8770</entry>
Nov 15 01:23:04 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:23:04 user nova-compute[74880]:     </system>
Nov 15 01:23:04 user nova-compute[74880]:   </sysinfo>
Nov 15 01:23:04 user nova-compute[74880]:   <os>
Nov 15 01:23:04 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:23:04 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:23:04 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:23:04 user nova-compute[74880]:   </os>
Nov 15 01:23:04 user nova-compute[74880]:   <features>
Nov 15 01:23:04 user nova-compute[74880]:     <acpi/>
Nov 15 01:23:04 user nova-compute[74880]:     <apic/>
Nov 15 01:23:04 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:23:04 user nova-compute[74880]:   </features>
Nov 15 01:23:04 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:23:04 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:23:04 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:23:04 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:23:04 user nova-compute[74880]:   </clock>
Nov 15 01:23:04 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:23:04 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:23:04 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:23:04 user nova-compute[74880]:   </cpu>
Nov 15 01:23:04 user nova-compute[74880]:   <devices>
Nov 15 01:23:04 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:23:04 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:23:04 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk"/>
Nov 15 01:23:04 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:23:04 user nova-compute[74880]:     </disk>
Nov 15 01:23:04 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:23:04 user nova-compute[74880]:       <mac address="fa:16:3e:83:c3:e0"/>
Nov 15 01:23:04 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:04 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:23:04 user nova-compute[74880]:       <target dev="tap8d49b499-57"/>
Nov 15 01:23:04 user nova-compute[74880]:     </interface>
Nov 15 01:23:04 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:23:04 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/console.log" append="off"/>
Nov 15 01:23:04 user nova-compute[74880]:     </serial>
Nov 15 01:23:04 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:23:04 user nova-compute[74880]:     <video>
Nov 15 01:23:04 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:04 user nova-compute[74880]:     </video>
Nov 15 01:23:04 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:23:04 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:23:04 user nova-compute[74880]:     </rng>
Nov 15 01:23:04 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:23:04 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:23:04 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:23:04 user nova-compute[74880]:     </memballoon>
Nov 15 01:23:04 user nova-compute[74880]:   </devices>
Nov 15 01:23:04 user nova-compute[74880]: </domain>
Nov 15 01:23:04 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-797180028',display_name='tempest-VolumesSnapshotTestJSON-instance-797180028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-797180028',id=25,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDEvXxmEWpIK9aFTrRG2prxiJaujDbb8xlBv+hIJLgDJdNawjN20M/kn3MxdHrFRsj7FR2pXVlcrqeBy0cnifF4xdYXIWfnqFtMpEFxuUZ8UHtTjymTrzYA8htcOYi4Cw==',key_name='tempest-keypair-247033617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fb3f3931294909bfc88b6569034b6d',ramdisk_id='',reservation_id='r-m2agh3in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-648990630',owner_user_name='tempest-VolumesSnapshotTestJSON-648990630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2750a138414933b47db189a233aaed',uuid=3a37e5f8-0c79-4a15-bef1-43a12b7b8770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converting VIF {"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG os_vif [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2819b264-560d-527d-b76f-7e6bcee734b9', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d49b499-57, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d49b499-57, col_values=(('qos', UUID('63416fee-4565-4c9a-9162-dbcc5f9704c1')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d49b499-57, col_values=(('external_ids', {'iface-id': '8d49b499-57bd-4d6e-a446-5cf63617047d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c3:e0', 'vm-uuid': '3a37e5f8-0c79-4a15-bef1-43a12b7b8770'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:04 user nova-compute[74880]: INFO os_vif [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57')
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No VIF found with MAC fa:16:3e:83:c3:e0, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:23:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updated VIF entry in instance network info cache for port 8d49b499-57bd-4d6e-a446-5cf63617047d. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:23:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updating instance_info_cache with network_info: [{"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5edf9ac8-3224-488e-bcd9-8523aa3b6936 req-c4d60bd1-9c7a-4cef-8bfd-e27827191e07 service nova] Releasing lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-8d647df3-8f3b-4a0d-a427-25d3c2a435a1 req-6d38368c-c972-481d-8c7b-3e6cad5d6a2d service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8d647df3-8f3b-4a0d-a427-25d3c2a435a1 req-6d38368c-c972-481d-8c7b-3e6cad5d6a2d service nova] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8d647df3-8f3b-4a0d-a427-25d3c2a435a1 req-6d38368c-c972-481d-8c7b-3e6cad5d6a2d service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8d647df3-8f3b-4a0d-a427-25d3c2a435a1 req-6d38368c-c972-481d-8c7b-3e6cad5d6a2d service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-8d647df3-8f3b-4a0d-a427-25d3c2a435a1 req-6d38368c-c972-481d-8c7b-3e6cad5d6a2d service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] No waiting events found dispatching network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:06 user nova-compute[74880]: WARNING nova.compute.manager [req-8d647df3-8f3b-4a0d-a427-25d3c2a435a1 req-6d38368c-c972-481d-8c7b-3e6cad5d6a2d service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received unexpected event network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d for instance with vm_state building and task_state spawning.
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:23:07 user nova-compute[74880]: INFO nova.compute.claims [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Claim successful on node user
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 req-6f75205e-6731-4d48-96a9-b71726c60dcf service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event volume-reimaged-c666dcc3-5e17-4d17-9705-7380b3794086 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 req-6f75205e-6731-4d48-96a9-b71726c60dcf service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 req-6f75205e-6731-4d48-96a9-b71726c60dcf service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 req-6f75205e-6731-4d48-96a9-b71726c60dcf service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 req-6f75205e-6731-4d48-96a9-b71726c60dcf service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Processing event volume-reimaged-c666dcc3-5e17-4d17-9705-7380b3794086 {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:23:07 user nova-compute[74880]: INFO nova.virt.block_device [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Booting with volume c666dcc3-5e17-4d17-9705-7380b3794086 at /dev/vda
Nov 15 01:23:07 user nova-compute[74880]: DEBUG os_brick.utils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df9739-7b1a-4f2b-bb8a-fd31140b05a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc562719-cfb4-4790-990b-e34d5ab5a5f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eebb34-22d0-4cc6-9283-95e0b1ad9ae7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[056e64c6-29de-4b31-bf50-05e2eb9243b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:07 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43ae75-641b-482e-b619-8bcc5fc2fadf]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG os_brick.utils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updating existing volume attachment record: c4f11037-80e4-41ea-a5dc-623e3720a806 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:23:07 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:23:07 user nova-compute[74880]: DEBUG nova.policy [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd34159a5cea6426f8e4303dbf20a99af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cac8f31694b1abcac7d3cfaac76ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:23:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Creating image(s)
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:23:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Instance spawned successfully.
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-0107cc0b-e16a-4df9-b74d-65a4aa47ac09 req-15594d52-93f8-468d-9c54-b3061de3328c service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0107cc0b-e16a-4df9-b74d-65a4aa47ac09 req-15594d52-93f8-468d-9c54-b3061de3328c service nova] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0107cc0b-e16a-4df9-b74d-65a4aa47ac09 req-15594d52-93f8-468d-9c54-b3061de3328c service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0107cc0b-e16a-4df9-b74d-65a4aa47ac09 req-15594d52-93f8-468d-9c54-b3061de3328c service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-0107cc0b-e16a-4df9-b74d-65a4aa47ac09 req-15594d52-93f8-468d-9c54-b3061de3328c service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] No waiting events found dispatching network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:08 user nova-compute[74880]: WARNING nova.compute.manager [req-0107cc0b-e16a-4df9-b74d-65a4aa47ac09 req-15594d52-93f8-468d-9c54-b3061de3328c service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received unexpected event network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d for instance with vm_state building and task_state spawning.
Nov 15 01:23:08 user nova-compute[74880]: INFO nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk 1073741824" returned: 0 in 0.053s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:08 user nova-compute[74880]: INFO nova.compute.manager [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Took 6.81 seconds to build instance.
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f1256dce-6447-4b56-860d-8fe6228e66f0 tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.903s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Successfully created port: 45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.218s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Cannot resize image /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Ensure instance console log exists: /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Successfully updated port: 45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.compute.manager [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-changed-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.compute.manager [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Refreshing instance network info cache due to event network-changed-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] Acquiring lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Instance network_info: |[{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] Acquired lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Refreshing network info cache for port 45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Start _get_guest_xml network_info=[{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132287468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132287468',id=26,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-67ya976u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:08Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=0b109ea6-ed08-4813-abe4-1cbcbdd35c32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:23:09 user nova-compute[74880]:   <uuid>0b109ea6-ed08-4813-abe4-1cbcbdd35c32</uuid>
Nov 15 01:23:09 user nova-compute[74880]:   <name>instance-0000001a</name>
Nov 15 01:23:09 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:23:09 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:23:09 user nova-compute[74880]:   <metadata>
Nov 15 01:23:09 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:23:09 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:23:09 user nova-compute[74880]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2132287468</nova:name>
Nov 15 01:23:09 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:23:09</nova:creationTime>
Nov 15 01:23:09 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:23:09 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:23:09 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:23:09 user nova-compute[74880]:       <nova:owner>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:user uuid="d34159a5cea6426f8e4303dbf20a99af">tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member</nova:user>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:project uuid="069cac8f31694b1abcac7d3cfaac76ed">tempest-ServerBootFromVolumeStableRescueTest-330586401</nova:project>
Nov 15 01:23:09 user nova-compute[74880]:       </nova:owner>
Nov 15 01:23:09 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:23:09 user nova-compute[74880]:       <nova:ports>
Nov 15 01:23:09 user nova-compute[74880]:         <nova:port uuid="45a215f8-fb46-43a0-8c6c-f9f071fcc6a2">
Nov 15 01:23:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:23:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:23:09 user nova-compute[74880]:       </nova:ports>
Nov 15 01:23:09 user nova-compute[74880]:     </nova:instance>
Nov 15 01:23:09 user nova-compute[74880]:   </metadata>
Nov 15 01:23:09 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:23:09 user nova-compute[74880]:     <system>
Nov 15 01:23:09 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:23:09 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:23:09 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:23:09 user nova-compute[74880]:       <entry name="serial">0b109ea6-ed08-4813-abe4-1cbcbdd35c32</entry>
Nov 15 01:23:09 user nova-compute[74880]:       <entry name="uuid">0b109ea6-ed08-4813-abe4-1cbcbdd35c32</entry>
Nov 15 01:23:09 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:23:09 user nova-compute[74880]:     </system>
Nov 15 01:23:09 user nova-compute[74880]:   </sysinfo>
Nov 15 01:23:09 user nova-compute[74880]:   <os>
Nov 15 01:23:09 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:23:09 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:23:09 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:23:09 user nova-compute[74880]:   </os>
Nov 15 01:23:09 user nova-compute[74880]:   <features>
Nov 15 01:23:09 user nova-compute[74880]:     <acpi/>
Nov 15 01:23:09 user nova-compute[74880]:     <apic/>
Nov 15 01:23:09 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:23:09 user nova-compute[74880]:   </features>
Nov 15 01:23:09 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:23:09 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:23:09 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:23:09 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:23:09 user nova-compute[74880]:   </clock>
Nov 15 01:23:09 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:23:09 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:23:09 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:23:09 user nova-compute[74880]:   </cpu>
Nov 15 01:23:09 user nova-compute[74880]:   <devices>
Nov 15 01:23:09 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:23:09 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:23:09 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk"/>
Nov 15 01:23:09 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:23:09 user nova-compute[74880]:     </disk>
Nov 15 01:23:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:23:09 user nova-compute[74880]:       <mac address="fa:16:3e:86:d5:9c"/>
Nov 15 01:23:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:23:09 user nova-compute[74880]:       <target dev="tap45a215f8-fb"/>
Nov 15 01:23:09 user nova-compute[74880]:     </interface>
Nov 15 01:23:09 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:23:09 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/console.log" append="off"/>
Nov 15 01:23:09 user nova-compute[74880]:     </serial>
Nov 15 01:23:09 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:23:09 user nova-compute[74880]:     <video>
Nov 15 01:23:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:09 user nova-compute[74880]:     </video>
Nov 15 01:23:09 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:23:09 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:23:09 user nova-compute[74880]:     </rng>
Nov 15 01:23:09 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:23:09 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:23:09 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:23:09 user nova-compute[74880]:     </memballoon>
Nov 15 01:23:09 user nova-compute[74880]:   </devices>
Nov 15 01:23:09 user nova-compute[74880]: </domain>
Nov 15 01:23:09 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132287468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132287468',id=26,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-67ya976u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:08Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=0b109ea6-ed08-4813-abe4-1cbcbdd35c32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG os_vif [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '511fc062-a482-5612-9cf4-817430f46bb2', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45a215f8-fb, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45a215f8-fb, col_values=(('qos', UUID('f365c9e1-797c-4694-a312-b50d8d428011')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45a215f8-fb, col_values=(('external_ids', {'iface-id': '45a215f8-fb46-43a0-8c6c-f9f071fcc6a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:d5:9c', 'vm-uuid': '0b109ea6-ed08-4813-abe4-1cbcbdd35c32'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:09 user nova-compute[74880]: INFO os_vif [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb')
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No VIF found with MAC fa:16:3e:86:d5:9c, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:23:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updated VIF entry in instance network info cache for port 45a215f8-fb46-43a0-8c6c-f9f071fcc6a2. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:23:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-26426bb8-87c5-47c3-8bb2-e62c3f537dfb req-2c7b80ab-fc1b-485a-ab83-29394ee3b4f4 service nova] Releasing lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-343b2b85-6459-48ec-84f0-f1a52f24a826 req-7ed0beb7-d79a-4831-855a-94130f1cfecd service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-343b2b85-6459-48ec-84f0-f1a52f24a826 req-7ed0beb7-d79a-4831-855a-94130f1cfecd service nova] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-343b2b85-6459-48ec-84f0-f1a52f24a826 req-7ed0beb7-d79a-4831-855a-94130f1cfecd service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-343b2b85-6459-48ec-84f0-f1a52f24a826 req-7ed0beb7-d79a-4831-855a-94130f1cfecd service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-343b2b85-6459-48ec-84f0-f1a52f24a826 req-7ed0beb7-d79a-4831-855a-94130f1cfecd service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] No waiting events found dispatching network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:11 user nova-compute[74880]: WARNING nova.compute.manager [req-343b2b85-6459-48ec-84f0-f1a52f24a826 req-7ed0beb7-d79a-4831-855a-94130f1cfecd service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received unexpected event network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 for instance with vm_state building and task_state spawning.
Nov 15 01:23:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:23:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Creating image(s)
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Ensure instance console log exists: /opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Start _get_guest_xml network_info=[{"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c666dcc3-5e17-4d17-9705-7380b3794086', 'serial': 'c666dcc3-5e17-4d17-9705-7380b3794086'}, 'mount_device': '/dev/vda', 'attachment_id': 'c4f11037-80e4-41ea-a5dc-623e3720a806', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:23:12 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 01:23:12 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:12 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:12 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:12 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab455b-d967-463a-ae04-f508893f6de5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:23:12 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f886ba-2b8b-4f17-a06d-867fc6e75b65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086] added
Nov 15 01:23:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cdf756-91ea-4ea7-97a6-9b1ce3a8eca1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[66979e2f-d2b9-488a-a1d6-d23f5db7ad59]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umrKJaHo {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umrKJaHo" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ed9293-be42-49a0-9967-757417fb29ec]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umrKJaHo'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab6b55-3ba3-4dd4-9191-8527a637288f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7aa67d-841c-4051-85c0-fbd915df1379]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db087c-8ec6-4955-98f1-3a12413ccf86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]
Nov 15 01:23:13 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.
Nov 15 01:23:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694a9ab-b863-4a55-aedb-30cd4975f7f8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb63a028-fbdd-46ba-a2be-57705860fd0e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:13 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:13 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b014c677-01bb-4585-b4f9-11fa41fe04bf]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:23:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Instance spawned successfully.
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-cacd4b1c-fc7f-4e64-a3d1-402d51f39b74 req-5966e189-8694-4acb-bf94-3aa58125dddc service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cacd4b1c-fc7f-4e64-a3d1-402d51f39b74 req-5966e189-8694-4acb-bf94-3aa58125dddc service nova] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cacd4b1c-fc7f-4e64-a3d1-402d51f39b74 req-5966e189-8694-4acb-bf94-3aa58125dddc service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cacd4b1c-fc7f-4e64-a3d1-402d51f39b74 req-5966e189-8694-4acb-bf94-3aa58125dddc service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-cacd4b1c-fc7f-4e64-a3d1-402d51f39b74 req-5966e189-8694-4acb-bf94-3aa58125dddc service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] No waiting events found dispatching network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:13 user nova-compute[74880]: WARNING nova.compute.manager [req-cacd4b1c-fc7f-4e64-a3d1-402d51f39b74 req-5966e189-8694-4acb-bf94-3aa58125dddc service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received unexpected event network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 for instance with vm_state building and task_state spawning.
Nov 15 01:23:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:13 user nova-compute[74880]: INFO nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 15 01:23:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:23:13 user nova-compute[74880]: INFO nova.compute.manager [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Took 6.72 seconds to build instance.
Nov 15 01:23:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7cea1cef-a508-4748-b8cb-70ae4c0250ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.822s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26634373264323064', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634373264323064', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312268747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-384987413',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMcAk9YFgMHc5QC18Zrh41amlCdbanvex0qu/dL79E4oEGET1gLpaDiVdfhJa9wrX/Cm9tleeuTYssjuZ3UjVPqkNb14qffQW15yrfOVUo9LgIFTkjeN4+fRuz5u+VKkA==',key_name='tempest-keypair-1641009201',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7eda993e255245fcbfe4e3044fbe51ce',ramdisk_id='',reservation_id='r-gi0obfpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-867042238',owner_user_name='tempest-ServerActionsV293TestJSON-867042238-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d027731a44c4b4eafba314166bd6006',uuid=2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converting VIF {"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:23:14 user nova-compute[74880]:   <uuid>2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f</uuid>
Nov 15 01:23:14 user nova-compute[74880]:   <name>instance-00000015</name>
Nov 15 01:23:14 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:23:14 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:23:14 user nova-compute[74880]:   <metadata>
Nov 15 01:23:14 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:23:14 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:23:14 user nova-compute[74880]:       <nova:name>tempest-ServerActionsV293TestJSON-server-312268747</nova:name>
Nov 15 01:23:14 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:23:12</nova:creationTime>
Nov 15 01:23:14 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:23:14 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:23:14 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:23:14 user nova-compute[74880]:       <nova:owner>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:user uuid="7d027731a44c4b4eafba314166bd6006">tempest-ServerActionsV293TestJSON-867042238-project-member</nova:user>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:project uuid="7eda993e255245fcbfe4e3044fbe51ce">tempest-ServerActionsV293TestJSON-867042238</nova:project>
Nov 15 01:23:14 user nova-compute[74880]:       </nova:owner>
Nov 15 01:23:14 user nova-compute[74880]:       <nova:ports>
Nov 15 01:23:14 user nova-compute[74880]:         <nova:port uuid="c826f62f-3a02-45e7-b066-392cbd32014e">
Nov 15 01:23:14 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 01:23:14 user nova-compute[74880]:         </nova:port>
Nov 15 01:23:14 user nova-compute[74880]:       </nova:ports>
Nov 15 01:23:14 user nova-compute[74880]:     </nova:instance>
Nov 15 01:23:14 user nova-compute[74880]:   </metadata>
Nov 15 01:23:14 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:23:14 user nova-compute[74880]:     <system>
Nov 15 01:23:14 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:23:14 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:23:14 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:23:14 user nova-compute[74880]:       <entry name="serial">2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f</entry>
Nov 15 01:23:14 user nova-compute[74880]:       <entry name="uuid">2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f</entry>
Nov 15 01:23:14 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:23:14 user nova-compute[74880]:     </system>
Nov 15 01:23:14 user nova-compute[74880]:   </sysinfo>
Nov 15 01:23:14 user nova-compute[74880]:   <os>
Nov 15 01:23:14 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:23:14 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:23:14 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:23:14 user nova-compute[74880]:   </os>
Nov 15 01:23:14 user nova-compute[74880]:   <features>
Nov 15 01:23:14 user nova-compute[74880]:     <acpi/>
Nov 15 01:23:14 user nova-compute[74880]:     <apic/>
Nov 15 01:23:14 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:23:14 user nova-compute[74880]:   </features>
Nov 15 01:23:14 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:23:14 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:23:14 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:23:14 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:23:14 user nova-compute[74880]:   </clock>
Nov 15 01:23:14 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:23:14 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:23:14 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:23:14 user nova-compute[74880]:   </cpu>
Nov 15 01:23:14 user nova-compute[74880]:   <devices>
Nov 15 01:23:14 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:23:14 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:23:14 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:23:14 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:23:14 user nova-compute[74880]:       <serial>c666dcc3-5e17-4d17-9705-7380b3794086</serial>
Nov 15 01:23:14 user nova-compute[74880]:     </disk>
Nov 15 01:23:14 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:23:14 user nova-compute[74880]:       <mac address="fa:16:3e:4e:ac:f1"/>
Nov 15 01:23:14 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:14 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:23:14 user nova-compute[74880]:       <target dev="tapc826f62f-3a"/>
Nov 15 01:23:14 user nova-compute[74880]:     </interface>
Nov 15 01:23:14 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:23:14 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f/console.log" append="off"/>
Nov 15 01:23:14 user nova-compute[74880]:     </serial>
Nov 15 01:23:14 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:23:14 user nova-compute[74880]:     <video>
Nov 15 01:23:14 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:14 user nova-compute[74880]:     </video>
Nov 15 01:23:14 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:23:14 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:23:14 user nova-compute[74880]:     </rng>
Nov 15 01:23:14 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:23:14 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:23:14 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:23:14 user nova-compute[74880]:     </memballoon>
Nov 15 01:23:14 user nova-compute[74880]:   </devices>
Nov 15 01:23:14 user nova-compute[74880]: </domain>
Nov 15 01:23:14 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312268747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-384987413',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMcAk9YFgMHc5QC18Zrh41amlCdbanvex0qu/dL79E4oEGET1gLpaDiVdfhJa9wrX/Cm9tleeuTYssjuZ3UjVPqkNb14qffQW15yrfOVUo9LgIFTkjeN4+fRuz5u+VKkA==',key_name='tempest-keypair-1641009201',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7eda993e255245fcbfe4e3044fbe51ce',ramdisk_id='',reservation_id='r-gi0obfpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-867042238',owner_user_name='tempest-ServerActionsV293TestJSON-867042238-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d027731a44c4b4eafba314166bd6006',uuid=2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converting VIF {"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG os_vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b61fe40-e6de-5eb0-a8b3-9b7243f6cb4b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc826f62f-3a, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc826f62f-3a, col_values=(('qos', UUID('cfd1928c-a6fd-4815-b61c-8f55b69748f7')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc826f62f-3a, col_values=(('external_ids', {'iface-id': 'c826f62f-3a02-45e7-b066-392cbd32014e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:ac:f1', 'vm-uuid': '2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:14 user nova-compute[74880]: INFO os_vif [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a')
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] No VIF found with MAC fa:16:3e:4e:ac:f1, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:23:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-a8049f3a-5079-4db1-b606-0d71836b6045 req-0ed65503-25db-4479-8d66-79e3cce82ace service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a8049f3a-5079-4db1-b606-0d71836b6045 req-0ed65503-25db-4479-8d66-79e3cce82ace service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a8049f3a-5079-4db1-b606-0d71836b6045 req-0ed65503-25db-4479-8d66-79e3cce82ace service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a8049f3a-5079-4db1-b606-0d71836b6045 req-0ed65503-25db-4479-8d66-79e3cce82ace service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-a8049f3a-5079-4db1-b606-0d71836b6045 req-0ed65503-25db-4479-8d66-79e3cce82ace service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:16 user nova-compute[74880]: WARNING nova.compute.manager [req-a8049f3a-5079-4db1-b606-0d71836b6045 req-0ed65503-25db-4479-8d66-79e3cce82ace service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state active and task_state rebuild_spawning.
Nov 15 01:23:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-699552a8-653d-430e-9ee1-561ff63dcf90 req-d6dc93a9-daad-4dcd-b601-a14f2faf6af9 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-699552a8-653d-430e-9ee1-561ff63dcf90 req-d6dc93a9-daad-4dcd-b601-a14f2faf6af9 service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-699552a8-653d-430e-9ee1-561ff63dcf90 req-d6dc93a9-daad-4dcd-b601-a14f2faf6af9 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-699552a8-653d-430e-9ee1-561ff63dcf90 req-d6dc93a9-daad-4dcd-b601-a14f2faf6af9 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-699552a8-653d-430e-9ee1-561ff63dcf90 req-d6dc93a9-daad-4dcd-b601-a14f2faf6af9 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:18 user nova-compute[74880]: WARNING nova.compute.manager [req-699552a8-653d-430e-9ee1-561ff63dcf90 req-d6dc93a9-daad-4dcd-b601-a14f2faf6af9 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state active and task_state rebuild_spawning.
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:23:18 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance spawned successfully.
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74880) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a9ac8326-4e0f-4520-8514-1b6bc61720e9 tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.135s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:18 user nova-compute[74880]: INFO nova.compute.manager [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Terminating instance
Nov 15 01:23:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Instance destroyed successfully.
Nov 15 01:23:19 user nova-compute[74880]: DEBUG nova.objects.instance [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'resources' on Instance uuid 2a7118ff-95dc-4cf1-a892-5ab701a1600e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-344540292',display_name='tempest-ServerActionsTestOtherA-server-1509883287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-344540292',id=15,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM30jO300DrwUN098zh7bTwkPEW0mV1Sl0lx8TlUkml7xDrjGooFZ46Urb83LosU78QkZtWenFmhVocTMQdNZO5q9PR3uzOnDyYcztQ/xZkcTN/+SDQcR7plYcLy61Q/WQ==',key_name='tempest-keypair-833480284',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-d786i2pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=2a7118ff-95dc-4cf1-a892-5ab701a1600e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "address": "fa:16:3e:52:70:a5", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb42a9438-2c", "ovs_interfaceid": "b42a9438-2c45-46c5-8a25-f0afc867d4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG os_vif [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb42a9438-2c, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c501aa0f-0403-48af-a262-a7aa814f6c4e) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:19 user nova-compute[74880]: INFO os_vif [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=b42a9438-2c45-46c5-8a25-f0afc867d4bb,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb42a9438-2c')
Nov 15 01:23:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Deleting instance files /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e_del
Nov 15 01:23:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Deletion of /opt/stack/data/nova/instances/2a7118ff-95dc-4cf1-a892-5ab701a1600e_del complete
Nov 15 01:23:19 user nova-compute[74880]: INFO nova.compute.manager [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 01:23:19 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:23:19 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-unplugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-unplugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-unplugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] Acquiring lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] No waiting events found dispatching network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:20 user nova-compute[74880]: WARNING nova.compute.manager [req-9bb3d86c-76b1-4eea-add4-f949cdfd426b req-f335a255-01ef-4ec9-bc84-6d6e9344a202 service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received unexpected event network-vif-plugged-b42a9438-2c45-46c5-8a25-f0afc867d4bb for instance with vm_state active and task_state deleting.
Nov 15 01:23:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:20 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:20 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Took 1.32 seconds to deallocate network for instance.
Nov 15 01:23:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:21 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:21 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:21 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Deleted allocations for instance 2a7118ff-95dc-4cf1-a892-5ab701a1600e
Nov 15 01:23:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1c2365-5dc4-4db1-b7a1-820074cd74c5 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "2a7118ff-95dc-4cf1-a892-5ab701a1600e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.285s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-changed-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Refreshing instance network info cache due to event network-changed-c8cc087a-3e14-4498-b978-4af7af884899. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] Acquiring lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] Acquired lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Refreshing network info cache for port c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-269f5779-d9cb-49ba-8d9b-d9538a75934c req-d6a37443-09cb-41b4-88c8-cfd7cb1c3def service nova] [instance: 2a7118ff-95dc-4cf1-a892-5ab701a1600e] Received event network-vif-deleted-b42a9438-2c45-46c5-8a25-f0afc867d4bb {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'flavor' on Instance uuid ad07de27-3fd2-466c-a066-0b2883bf68a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updated VIF entry in instance network info cache for port c8cc087a-3e14-4498-b978-4af7af884899. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updating instance_info_cache with network_info: [{"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c650f72a-8b9d-40a6-809a-8793fb2337e7 req-bff470bc-feae-419a-a916-1c08e1d58754 service nova] Releasing lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:23 user nova-compute[74880]: INFO nova.compute.manager [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Attaching volume d5db070e-461b-477c-8175-a3f9d8fd3d92 to /dev/vdb
Nov 15 01:23:23 user nova-compute[74880]: DEBUG os_brick.utils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d771657-37ce-46c2-b5f4-269ff5b3e64b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[51759a07-2104-4c68-b015-4718d5660f12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[180fc325-63ab-41da-a6b7-3b2b2ea31197]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[553fd28d-b572-417a-b365-7616e0309edf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:23 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:23:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca686fe4-1827-4fc3-98c1-abf1923d3ded]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG os_brick.utils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:23 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updating existing volume attachment record: 19ccb579-7dd4-49d5-9c50-fb74ae1d5742 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:23:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:23:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:23:25 user nova-compute[74880]: INFO nova.compute.claims [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Claim successful on node user
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:23:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.policy [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66ea86fccfa749a6a52ac67af682af26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad971c8d358435095c37d13aac7a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:23:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Creating image(s)
Nov 15 01:23:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk 1073741824" returned: 0 in 0.066s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Successfully created port: 867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Cannot resize image /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Ensure instance console log exists: /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Successfully updated port: 867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquired lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-changed-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Refreshing instance network info cache due to event network-changed-867c6194-568e-45ef-8222-558e115db573. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] Acquiring lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Releasing lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance network_info: |[{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] Acquired lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.neutron [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Refreshing network info cache for port 867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start _get_guest_xml network_info=[{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCLSiKlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:28 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:28 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:28 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:28 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'pci_devices' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee315d-7311-4f16-a682-62584abc0e0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:23:28 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:23:28 user nova-compute[74880]:   <uuid>395fbdae-60fb-4d53-a8b5-731eb60a1c18</uuid>
Nov 15 01:23:28 user nova-compute[74880]:   <name>instance-0000001b</name>
Nov 15 01:23:28 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:23:28 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:23:28 user nova-compute[74880]:   <metadata>
Nov 15 01:23:28 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:23:28 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:23:28 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeTestJSON-server-944524409</nova:name>
Nov 15 01:23:28 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:23:28</nova:creationTime>
Nov 15 01:23:28 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:23:28 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:23:28 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:23:28 user nova-compute[74880]:       <nova:owner>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:user uuid="66ea86fccfa749a6a52ac67af682af26">tempest-AttachVolumeTestJSON-1609488545-project-member</nova:user>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:project uuid="0ad971c8d358435095c37d13aac7a30c">tempest-AttachVolumeTestJSON-1609488545</nova:project>
Nov 15 01:23:28 user nova-compute[74880]:       </nova:owner>
Nov 15 01:23:28 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:23:28 user nova-compute[74880]:       <nova:ports>
Nov 15 01:23:28 user nova-compute[74880]:         <nova:port uuid="867c6194-568e-45ef-8222-558e115db573">
Nov 15 01:23:28 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:23:28 user nova-compute[74880]:         </nova:port>
Nov 15 01:23:28 user nova-compute[74880]:       </nova:ports>
Nov 15 01:23:28 user nova-compute[74880]:     </nova:instance>
Nov 15 01:23:28 user nova-compute[74880]:   </metadata>
Nov 15 01:23:28 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:23:28 user nova-compute[74880]:     <system>
Nov 15 01:23:28 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:23:28 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:23:28 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:23:28 user nova-compute[74880]:       <entry name="serial">395fbdae-60fb-4d53-a8b5-731eb60a1c18</entry>
Nov 15 01:23:28 user nova-compute[74880]:       <entry name="uuid">395fbdae-60fb-4d53-a8b5-731eb60a1c18</entry>
Nov 15 01:23:28 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:23:28 user nova-compute[74880]:     </system>
Nov 15 01:23:28 user nova-compute[74880]:   </sysinfo>
Nov 15 01:23:28 user nova-compute[74880]:   <os>
Nov 15 01:23:28 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:23:28 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:23:28 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:23:28 user nova-compute[74880]:   </os>
Nov 15 01:23:28 user nova-compute[74880]:   <features>
Nov 15 01:23:28 user nova-compute[74880]:     <acpi/>
Nov 15 01:23:28 user nova-compute[74880]:     <apic/>
Nov 15 01:23:28 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:23:28 user nova-compute[74880]:   </features>
Nov 15 01:23:28 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:23:28 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:23:28 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:23:28 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:23:28 user nova-compute[74880]:   </clock>
Nov 15 01:23:28 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:23:28 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:23:28 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:23:28 user nova-compute[74880]:   </cpu>
Nov 15 01:23:28 user nova-compute[74880]:   <devices>
Nov 15 01:23:28 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:23:28 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:23:28 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk"/>
Nov 15 01:23:28 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:23:28 user nova-compute[74880]:     </disk>
Nov 15 01:23:28 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:23:28 user nova-compute[74880]:       <mac address="fa:16:3e:45:24:9c"/>
Nov 15 01:23:28 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:28 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:23:28 user nova-compute[74880]:       <target dev="tap867c6194-56"/>
Nov 15 01:23:28 user nova-compute[74880]:     </interface>
Nov 15 01:23:28 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:23:28 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/console.log" append="off"/>
Nov 15 01:23:28 user nova-compute[74880]:     </serial>
Nov 15 01:23:28 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:23:28 user nova-compute[74880]:     <video>
Nov 15 01:23:28 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:28 user nova-compute[74880]:     </video>
Nov 15 01:23:28 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:23:28 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:23:28 user nova-compute[74880]:     </rng>
Nov 15 01:23:28 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:23:28 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:23:28 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:23:28 user nova-compute[74880]:     </memballoon>
Nov 15 01:23:28 user nova-compute[74880]:   </devices>
Nov 15 01:23:28 user nova-compute[74880]: </domain>
Nov 15 01:23:28 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_vif [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f417a383-8e31-5e95-95c7-cb0ea81efca9', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867c6194-56, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867c6194-56, col_values=(('qos', UUID('d738aadf-24cf-4679-8494-a5d56859f5a0')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867c6194-56, col_values=(('external_ids', {'iface-id': '867c6194-568e-45ef-8222-558e115db573', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:24:9c', 'vm-uuid': '395fbdae-60fb-4d53-a8b5-731eb60a1c18'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67068750-c2c7-412a-bb14-71113efea3f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92] added
Nov 15 01:23:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:28 user nova-compute[74880]: INFO os_vif [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56')
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6dca4d-d141-4a42-bab1-cab366a65a09]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fb49f-6218-4a74-b582-2addc8b9a95d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCLSiKlh {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCLSiKlh" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1d6d47-682c-4ced-84db-1be242607741]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCLSiKlh'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No VIF found with MAC fa:16:3e:45:24:9c, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a536ba-873b-406f-a5bf-46c7f55f6bd1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5adee30-8a43-476c-9131-0a408c52529a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b9c1c-3271-4a91-b3a0-5e49b996784a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260]
Nov 15 01:23:28 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260] successful.
Nov 15 01:23:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6339e8-db93-4a03-a962-27c08c5ceed6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[91980560-3af2-43cb-a1aa-d08d07f3f1a5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2677d73b-9fd7-4c7c-bb4c-6de86e497db1]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:23:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCLSiKlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:23:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updated VIF entry in instance network info cache for port 867c6194-568e-45ef-8222-558e115db573. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:23:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c417724a-d3fb-493a-a714-6fa6fe38b868 req-8b934057-86e5-4a8b-9a9b-8d3ca553db17 service nova] Releasing lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26132636139336662', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132636139336662', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'flavor' on Instance uuid ad07de27-3fd2-466c-a066-0b2883bf68a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:23:30 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:23:30 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:23:30 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:23:30 user nova-compute[74880]:   <serial>d5db070e-461b-477c-8175-a3f9d8fd3d92</serial>
Nov 15 01:23:30 user nova-compute[74880]: </disk>
Nov 15 01:23:30 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-7b10d9f3-1359-491d-b7d5-ae09c1847b18 req-8d73e5fb-15e3-4396-9c04-8a11fcd20b9f service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7b10d9f3-1359-491d-b7d5-ae09c1847b18 req-8d73e5fb-15e3-4396-9c04-8a11fcd20b9f service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7b10d9f3-1359-491d-b7d5-ae09c1847b18 req-8d73e5fb-15e3-4396-9c04-8a11fcd20b9f service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7b10d9f3-1359-491d-b7d5-ae09c1847b18 req-8d73e5fb-15e3-4396-9c04-8a11fcd20b9f service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-7b10d9f3-1359-491d-b7d5-ae09c1847b18 req-8d73e5fb-15e3-4396-9c04-8a11fcd20b9f service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:30 user nova-compute[74880]: WARNING nova.compute.manager [req-7b10d9f3-1359-491d-b7d5-ae09c1847b18 req-8d73e5fb-15e3-4396-9c04-8a11fcd20b9f service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state building and task_state spawning.
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No VIF found with MAC fa:16:3e:5c:16:be, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ba087156-413e-4373-ac85-f93001ba5b8d tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.646s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-aa1c95d8-9dd9-4bfc-a61a-cdcc5aa31785 req-9d14aa9d-8601-4a0f-82ed-d83c86bc5bc5 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aa1c95d8-9dd9-4bfc-a61a-cdcc5aa31785 req-9d14aa9d-8601-4a0f-82ed-d83c86bc5bc5 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aa1c95d8-9dd9-4bfc-a61a-cdcc5aa31785 req-9d14aa9d-8601-4a0f-82ed-d83c86bc5bc5 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aa1c95d8-9dd9-4bfc-a61a-cdcc5aa31785 req-9d14aa9d-8601-4a0f-82ed-d83c86bc5bc5 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-aa1c95d8-9dd9-4bfc-a61a-cdcc5aa31785 req-9d14aa9d-8601-4a0f-82ed-d83c86bc5bc5 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:32 user nova-compute[74880]: WARNING nova.compute.manager [req-aa1c95d8-9dd9-4bfc-a61a-cdcc5aa31785 req-9d14aa9d-8601-4a0f-82ed-d83c86bc5bc5 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state building and task_state spawning.
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:23:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance spawned successfully.
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:23:32 user nova-compute[74880]: INFO nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 15 01:23:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:23:33 user nova-compute[74880]: INFO nova.compute.manager [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Took 7.21 seconds to build instance.
Nov 15 01:23:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8eacee7b-f352-4954-a664-b6f225af8201 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.380s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:34 user nova-compute[74880]: INFO nova.compute.manager [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Detaching volume d5db070e-461b-477c-8175-a3f9d8fd3d92
Nov 15 01:23:34 user nova-compute[74880]: INFO nova.virt.block_device [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Attempting to driver detach volume d5db070e-461b-477c-8175-a3f9d8fd3d92 from mountpoint /dev/vdb
Nov 15 01:23:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Attempting to detach device vdb from instance ad07de27-3fd2-466c-a066-0b2883bf68a8 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:23:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:23:34 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:23:34 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:23:34 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:23:34 user nova-compute[74880]:   <serial>d5db070e-461b-477c-8175-a3f9d8fd3d92</serial>
Nov 15 01:23:34 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:23:34 user nova-compute[74880]: </disk>
Nov 15 01:23:34 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:23:34 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully detached device vdb from instance ad07de27-3fd2-466c-a066-0b2883bf68a8 from the persistent domain config.
Nov 15 01:23:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad07de27-3fd2-466c-a066-0b2883bf68a8 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:23:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:23:34 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:23:34 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:23:34 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:23:34 user nova-compute[74880]:   <serial>d5db070e-461b-477c-8175-a3f9d8fd3d92</serial>
Nov 15 01:23:34 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:23:34 user nova-compute[74880]: </disk>
Nov 15 01:23:34 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:23:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad07de27-3fd2-466c-a066-0b2883bf68a8 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:23:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:42 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:42 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:43 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:43 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:43 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:43 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:23:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:47 user nova-compute[74880]: INFO nova.compute.manager [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Unshelving
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: INFO nova.virt.block_device [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Booting with volume 36a84c65-dc09-45db-89fd-d1e2403ae4b5 at /dev/vda
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG os_brick.utils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e578f903-21d6-4af7-886d-810c43c737a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceb6335-0e59-45fe-8bce-3f05fde7e894]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4940b9-b3a2-483b-82d0-a5c3833655af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb6a087-e9ad-4928-ae77-1b0c458f2969]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:47 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9933ed-a1ee-48ab-bf96-0c2f211d4e7a]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG os_brick.utils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating existing volume attachment record: bd1a51ff-15fa-48fa-b884-dd2f1518a4d9 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Port 6fe814ba-5ec3-4038-9d2e-694980cd4ed3 binding to destination host user is already ACTIVE {{(pid=74880) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Creating tmpfile /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/tmpg5ujmsio to verify with other compute node that the instance is on the same shared storage. {{(pid=74880) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-05eef2e2-03d5-4af6-924b-7a32fabe9c22 req-033b3d31-be78-40e3-9a8a-fb6a47847e52 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-05eef2e2-03d5-4af6-924b-7a32fabe9c22 req-033b3d31-be78-40e3-9a8a-fb6a47847e52 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-05eef2e2-03d5-4af6-924b-7a32fabe9c22 req-033b3d31-be78-40e3-9a8a-fb6a47847e52 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-05eef2e2-03d5-4af6-924b-7a32fabe9c22 req-033b3d31-be78-40e3-9a8a-fb6a47847e52 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-05eef2e2-03d5-4af6-924b-7a32fabe9c22 req-033b3d31-be78-40e3-9a8a-fb6a47847e52 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:49 user nova-compute[74880]: WARNING nova.compute.manager [req-05eef2e2-03d5-4af6-924b-7a32fabe9c22 req-033b3d31-be78-40e3-9a8a-fb6a47847e52 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state resized and task_state resize_reverting.
Nov 15 01:23:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance destroyed successfully.
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'resources' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:49 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:49 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7108MB free_disk=25.460628509521484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fe814ba-5e, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aaf7fe9-384a-48fe-acbe-3fb2b87e2dae) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:49 user nova-compute[74880]: INFO os_vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e')
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6f125-99b2-4d07-8832-359d6449f629]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:23:49 user nova-compute[74880]: No targets found.
Nov 15 01:23:49 user nova-compute[74880]: iSNS:
Nov 15 01:23:49 user nova-compute[74880]: No targets found.
Nov 15 01:23:49 user nova-compute[74880]: STATIC:
Nov 15 01:23:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:23:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:23:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:23:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:23:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:23:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:23:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92
Nov 15 01:23:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:23:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:23:49 user nova-compute[74880]: FIRMWARE:
Nov 15 01:23:49 user nova-compute[74880]: No targets found.
Nov 15 01:23:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:23:49 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:23:49 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c86217-940a-4b1b-934b-f146f23c3b6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1aa8a6-6eba-472a-b753-bb632e4a5dcc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:49 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:49 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:49 user nova-compute[74880]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:49 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01d89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Applying migration context for instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d as it has an incoming, in-progress migration 112272ae-b8e1-460b-a20e-0623a226c748. Migration status is reverting {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 01:23:49 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating resource usage from migration 112272ae-b8e1-460b-a20e-0623a226c748
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ab681-0df7-44b9-a2c0-7a888e8c7adb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Migration 112272ae-b8e1-460b-a20e-0623a226c748 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 88540810-db28-4f01-aa45-5cc4497214e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 1fc1c56b-bf28-4060-80c8-1552e2632bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93f828-5ae7-4127-9153-11b3d820a88c]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a198cb73-9836-4afc-aa2f-0d97b399ea6a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856f9e8-6deb-43df-a657-a94701753a3e]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6804ceed-e6bf-45c1-9468-826b35fc62df]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c89a74c-8961-4ba9-b5fa-9a15b969d60c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]
Nov 15 01:23:49 user nova-compute[74880]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.
Nov 15 01:23:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a2898d-6c33-4383-a8da-18d929f8d7ae]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== disconnect_volume: return (336ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'migration_context' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:50 user nova-compute[74880]: DEBUG nova.objects.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Object Instance<00eda474-3fbc-45ce-8986-6e8cbb90bd2d> lazy-loaded attributes: resources,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f5d94e6-e91b-4fbc-9edb-5a318632f933 req-e4dd231a-0bab-47f0-a3de-cf3fc693bbfc service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f5d94e6-e91b-4fbc-9edb-5a318632f933 req-e4dd231a-0bab-47f0-a3de-cf3fc693bbfc service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f5d94e6-e91b-4fbc-9edb-5a318632f933 req-e4dd231a-0bab-47f0-a3de-cf3fc693bbfc service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f5d94e6-e91b-4fbc-9edb-5a318632f933 req-e4dd231a-0bab-47f0-a3de-cf3fc693bbfc service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f5d94e6-e91b-4fbc-9edb-5a318632f933 req-e4dd231a-0bab-47f0-a3de-cf3fc693bbfc service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:51 user nova-compute[74880]: WARNING nova.compute.manager [req-3f5d94e6-e91b-4fbc-9edb-5a318632f933 req-e4dd231a-0bab-47f0-a3de-cf3fc693bbfc service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state resized and task_state resize_reverting.
Nov 15 01:23:51 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.530s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:51 user nova-compute[74880]: INFO nova.compute.manager [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Swapping old allocation on dict_keys(['51756651-d511-4749-8c0a-4c67c2051bce']) held by migration 112272ae-b8e1-460b-a20e-0623a226c748 for instance
Nov 15 01:23:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Overwriting current allocation {'allocations': {'51756651-d511-4749-8c0a-4c67c2051bce': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 32}}, 'project_id': 'b855ee7bc0e344ac836b02b1e86c3798', 'user_id': 'baa7a9a3c7994818bee910e2bf0e6043', 'consumer_generation': 1} on consumer 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:23:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d4e39-db90-4d79-b786-fa370b594cbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d649dbb-0db3-4807-9587-e241f51b4fdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4a69e5-bec5-4211-acc9-1989363a2387]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583fce8-e060-42f8-ae82-9f6611552777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:23:52 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52aba79-2c13-4ceb-97b2-197d3635d247]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG os_brick.utils [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'pci_requests' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'numa_topology' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:23:52 user nova-compute[74880]: INFO nova.compute.claims [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Claim successful on node user
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-00eda474-3fbc-45ce-8986-6e8cbb90bd2d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:23:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:52 user nova-compute[74880]: INFO nova.network.neutron [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing instance network info cache due to event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:23:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:23:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Creating image(s)
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Ensure instance console log exists: /opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Start _get_guest_xml network_info=[{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13e06f94-a4f0-4902-ab35-61e4fd7bfc42', 'attached_at': '', 'detached_at': '', 'volume_id': '36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'serial': '36a84c65-dc09-45db-89fd-d1e2403ae4b5'}, 'mount_device': '/dev/vda', 'attachment_id': 'bd1a51ff-15fa-48fa-b884-dd2f1518a4d9', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:23:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.objects.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Object Instance<13e06f94-a4f0-4902-ab35-61e4fd7bfc42> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:54 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:54 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:54 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a83a31-0ce2-453f-a73e-b36f542ba62e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:23:54 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b797ad-47dc-4a8d-a5a7-92f055801b63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5] added
Nov 15 01:23:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7517c3d-9395-495b-9c44-97aa657e3b7e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd0c479-b541-4fe5-a207-ec3756a79e98]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGVTloYy {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGVTloYy" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0a5bf3-96f3-4c16-8ab2-d979d564806b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGVTloYy'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18477d44-1022-434c-8aee-0956d75c8241]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd0296-cdd7-488e-adde-5cb648cc9c93]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[27891370-8ae6-4ce3-867b-b60ef93b24fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]
Nov 15 01:23:54 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.
Nov 15 01:23:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48bf707-d58a-45a9-9954-30f29d568d3c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f31cd-bc48-493a-9d66-c4036d1cb7c7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:54 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed3b7f-141d-48ef-9fe3-d9b985779d80]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updated VIF entry in instance network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a5f99223-c847-4f72-8f1b-44d57272beab req-2b142988-ad49-4d13-a684-e0fa58b151b6 service nova] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:23:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad07de27-3fd2-466c-a066-0b2883bf68a8 is timed out.
Nov 15 01:23:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully detached device vdb from instance ad07de27-3fd2-466c-a066-0b2883bf68a8 from the live domain config.
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCLSiKlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:55 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23038613762616530', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038613762616530', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.414s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-302427772',display_name='tempest-TestShelveInstance-server-302427772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-302427772',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-307644609',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0b0a12699b5248acaeb4a4f4e749647d',ramdisk_id='',reservation_id='r-kdr1j5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1190185298',owner_user_name='tempest-TestShelveInstance-1190185298-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:47Z,user_data=None,user_id='f9842f5af61240cfbb507e82bffbc15f',uuid=13e06f94-a4f0-4902-ab35-61e4fd7bfc42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converting VIF {"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'pci_devices' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cae1bd-5418-4604-95f9-0d44c659a61a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:23:55 user nova-compute[74880]: No targets found.
Nov 15 01:23:55 user nova-compute[74880]: iSNS:
Nov 15 01:23:55 user nova-compute[74880]: No targets found.
Nov 15 01:23:55 user nova-compute[74880]: STATIC:
Nov 15 01:23:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:23:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:23:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:23:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92
Nov 15 01:23:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:23:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:23:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:23:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:23:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:23:55 user nova-compute[74880]: FIRMWARE:
Nov 15 01:23:55 user nova-compute[74880]: No targets found.
Nov 15 01:23:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:23:55 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:23:55 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.objects.base [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Object Instance<13e06f94-a4f0-4902-ab35-61e4fd7bfc42> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:23:55 user nova-compute[74880]:   <uuid>13e06f94-a4f0-4902-ab35-61e4fd7bfc42</uuid>
Nov 15 01:23:55 user nova-compute[74880]:   <name>instance-00000014</name>
Nov 15 01:23:55 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:23:55 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:23:55 user nova-compute[74880]:   <metadata>
Nov 15 01:23:55 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:23:55 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:23:55 user nova-compute[74880]:       <nova:name>tempest-TestShelveInstance-server-302427772</nova:name>
Nov 15 01:23:55 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:23:54</nova:creationTime>
Nov 15 01:23:55 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:23:55 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:23:55 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:23:55 user nova-compute[74880]:       <nova:owner>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:user uuid="f9842f5af61240cfbb507e82bffbc15f">tempest-TestShelveInstance-1190185298-project-member</nova:user>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:project uuid="0b0a12699b5248acaeb4a4f4e749647d">tempest-TestShelveInstance-1190185298</nova:project>
Nov 15 01:23:55 user nova-compute[74880]:       </nova:owner>
Nov 15 01:23:55 user nova-compute[74880]:       <nova:ports>
Nov 15 01:23:55 user nova-compute[74880]:         <nova:port uuid="5dc4646f-3ae7-4e83-beae-a2da33ad6ce1">
Nov 15 01:23:55 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:23:55 user nova-compute[74880]:         </nova:port>
Nov 15 01:23:55 user nova-compute[74880]:       </nova:ports>
Nov 15 01:23:55 user nova-compute[74880]:     </nova:instance>
Nov 15 01:23:55 user nova-compute[74880]:   </metadata>
Nov 15 01:23:55 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:23:55 user nova-compute[74880]:     <system>
Nov 15 01:23:55 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:23:55 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:23:55 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:23:55 user nova-compute[74880]:       <entry name="serial">13e06f94-a4f0-4902-ab35-61e4fd7bfc42</entry>
Nov 15 01:23:55 user nova-compute[74880]:       <entry name="uuid">13e06f94-a4f0-4902-ab35-61e4fd7bfc42</entry>
Nov 15 01:23:55 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:23:55 user nova-compute[74880]:     </system>
Nov 15 01:23:55 user nova-compute[74880]:   </sysinfo>
Nov 15 01:23:55 user nova-compute[74880]:   <os>
Nov 15 01:23:55 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:23:55 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:23:55 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:23:55 user nova-compute[74880]:   </os>
Nov 15 01:23:55 user nova-compute[74880]:   <features>
Nov 15 01:23:55 user nova-compute[74880]:     <acpi/>
Nov 15 01:23:55 user nova-compute[74880]:     <apic/>
Nov 15 01:23:55 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:23:55 user nova-compute[74880]:   </features>
Nov 15 01:23:55 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:23:55 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:23:55 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:23:55 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:23:55 user nova-compute[74880]:   </clock>
Nov 15 01:23:55 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:23:55 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:23:55 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:23:55 user nova-compute[74880]:   </cpu>
Nov 15 01:23:55 user nova-compute[74880]:   <devices>
Nov 15 01:23:55 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:23:55 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:23:55 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:23:55 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:23:55 user nova-compute[74880]:       <serial>36a84c65-dc09-45db-89fd-d1e2403ae4b5</serial>
Nov 15 01:23:55 user nova-compute[74880]:     </disk>
Nov 15 01:23:55 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:23:55 user nova-compute[74880]:       <mac address="fa:16:3e:82:81:3f"/>
Nov 15 01:23:55 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:55 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:23:55 user nova-compute[74880]:       <target dev="tap5dc4646f-3a"/>
Nov 15 01:23:55 user nova-compute[74880]:     </interface>
Nov 15 01:23:55 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:23:55 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42/console.log" append="off"/>
Nov 15 01:23:55 user nova-compute[74880]:     </serial>
Nov 15 01:23:55 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:23:55 user nova-compute[74880]:     <video>
Nov 15 01:23:55 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:55 user nova-compute[74880]:     </video>
Nov 15 01:23:55 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:23:55 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:23:55 user nova-compute[74880]:     </rng>
Nov 15 01:23:55 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:23:55 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:23:55 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:23:55 user nova-compute[74880]:     </memballoon>
Nov 15 01:23:55 user nova-compute[74880]:   </devices>
Nov 15 01:23:55 user nova-compute[74880]: </domain>
Nov 15 01:23:55 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-302427772',display_name='tempest-TestShelveInstance-server-302427772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-302427772',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-307644609',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0b0a12699b5248acaeb4a4f4e749647d',ramdisk_id='',reservation_id='r-kdr1j5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1190185298',owner_user_name='tempest-TestShelveInstance-1190185298-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:47Z,user_data=None,user_id='f9842f5af61240cfbb507e82bffbc15f',uuid=13e06f94-a4f0-4902-ab35-61e4fd7bfc42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converting VIF {"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_vif [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c24a25b4-e81e-51cf-80f8-5908418eb4be', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dd6a7a-6eca-43dd-8714-ca4f9a6f841e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dc4646f-3a, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dc4646f-3a, col_values=(('qos', UUID('1a1138b0-3106-4ebf-98e8-ba6b697fe95e')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dc4646f-3a, col_values=(('external_ids', {'iface-id': '5dc4646f-3ae7-4e83-beae-a2da33ad6ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:81:3f', 'vm-uuid': '13e06f94-a4f0-4902-ab35-61e4fd7bfc42'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:55 user nova-compute[74880]: INFO os_vif [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a')
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[881b94d8-7d35-4b47-9246-748cf94ac393]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:55 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:55 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:55 user nova-compute[74880]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 (non-flash)
Nov 15 01:23:55 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06b1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd18996e-2a00-413f-a988-845fe536ea92]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68057d2-44a7-485c-8e20-6f7076f69255]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] No VIF found with MAC fa:16:3e:82:81:3f, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d86f3-2353-4f58-8d3f-bc8af68da299]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf45de33-2d94-420a-bb5a-7353f7d7fbee]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7adbf-ca15-4580-81a9-e6969f1d6c9c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65818d5a-b7a3-4138-a9e3-85c9a30e7464]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260]
Nov 15 01:23:55 user nova-compute[74880]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92, portal: 172.16.0.220,3260] successful.
Nov 15 01:23:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5db070e-461b-477c-8175-a3f9d8fd3d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60983c8-b22f-48cf-9432-2c0f4cc63136]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] <== disconnect_volume: return (726ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.objects.instance [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'flavor' on Instance uuid ad07de27-3fd2-466c-a066-0b2883bf68a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-32a40330-bc30-4a39-bb7b-e9b50c025e4f tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.057s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Starting finish_revert_migration {{(pid=74880) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start _get_guest_xml network_info=[{"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '00eda474-3fbc-45ce-8986-6e8cbb90bd2d', 'attached_at': '2023-11-15T01:23:57.000000', 'detached_at': '', 'volume_id': '1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'serial': '1ed8b916-c70c-4ec7-8424-efb9d161d7e9'}, 'mount_device': '/dev/vdb', 'attachment_id': 'e85b6fd8-2b8b-4be0-a5f8-cac96a08168b', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:23:56 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:56 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:23:56 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:56 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:23:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:23:56 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:23:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b36d361-8545-41e4-9502-a75bc38186ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:23:56 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fb02b5-9b41-490d-ba1c-5677f1258176]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9] added
Nov 15 01:23:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-5fd76f51-2ed0-4451-bd12-f270f5c9620e req-3ffd5bc3-e0d8-472b-9fc3-31c935c4ad24 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5fd76f51-2ed0-4451-bd12-f270f5c9620e req-3ffd5bc3-e0d8-472b-9fc3-31c935c4ad24 service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5fd76f51-2ed0-4451-bd12-f270f5c9620e req-3ffd5bc3-e0d8-472b-9fc3-31c935c4ad24 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5fd76f51-2ed0-4451-bd12-f270f5c9620e req-3ffd5bc3-e0d8-472b-9fc3-31c935c4ad24 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-5fd76f51-2ed0-4451-bd12-f270f5c9620e req-3ffd5bc3-e0d8-472b-9fc3-31c935c4ad24 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:57 user nova-compute[74880]: WARNING nova.compute.manager [req-5fd76f51-2ed0-4451-bd12-f270f5c9620e req-3ffd5bc3-e0d8-472b-9fc3-31c935c4ad24 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5d8c1-bb57-4698-98af-c51c09ad03a6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc6c33-9977-4223-8644-591850e9b3f7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzapVJQv {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzapVJQv" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac5f2b2-dc3b-48d2-b2b1-7a44866005e8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZzapVJQv'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d2361-fb39-46d3-bcbb-9a265558bfa3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1863ad5e-ef20-41ff-88c4-05f906cac031]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc90d5-757a-4da8-8a46-3f269efaf9a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]
Nov 15 01:23:57 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.
Nov 15 01:23:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8984df84-6187-4901-9556-b252c13f0ceb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294c0f3-3237-4b16-8341-805bbbaf3759]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:23:57 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[61461c91-2755-400b-b298-4a07caba11b5]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26463616331346332', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463616331346332', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:23:58 user nova-compute[74880]:   <uuid>00eda474-3fbc-45ce-8986-6e8cbb90bd2d</uuid>
Nov 15 01:23:58 user nova-compute[74880]:   <name>instance-00000011</name>
Nov 15 01:23:58 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:23:58 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:23:58 user nova-compute[74880]:   <metadata>
Nov 15 01:23:58 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:23:58 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:23:58 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherB-server-1351279143</nova:name>
Nov 15 01:23:58 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:23:56</nova:creationTime>
Nov 15 01:23:58 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:23:58 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:23:58 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:23:58 user nova-compute[74880]:       <nova:owner>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:user uuid="baa7a9a3c7994818bee910e2bf0e6043">tempest-ServerActionsTestOtherB-230839994-project-member</nova:user>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:project uuid="b855ee7bc0e344ac836b02b1e86c3798">tempest-ServerActionsTestOtherB-230839994</nova:project>
Nov 15 01:23:58 user nova-compute[74880]:       </nova:owner>
Nov 15 01:23:58 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:23:58 user nova-compute[74880]:       <nova:ports>
Nov 15 01:23:58 user nova-compute[74880]:         <nova:port uuid="6fe814ba-5ec3-4038-9d2e-694980cd4ed3">
Nov 15 01:23:58 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:23:58 user nova-compute[74880]:         </nova:port>
Nov 15 01:23:58 user nova-compute[74880]:       </nova:ports>
Nov 15 01:23:58 user nova-compute[74880]:     </nova:instance>
Nov 15 01:23:58 user nova-compute[74880]:   </metadata>
Nov 15 01:23:58 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:23:58 user nova-compute[74880]:     <system>
Nov 15 01:23:58 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:23:58 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:23:58 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:23:58 user nova-compute[74880]:       <entry name="serial">00eda474-3fbc-45ce-8986-6e8cbb90bd2d</entry>
Nov 15 01:23:58 user nova-compute[74880]:       <entry name="uuid">00eda474-3fbc-45ce-8986-6e8cbb90bd2d</entry>
Nov 15 01:23:58 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:23:58 user nova-compute[74880]:     </system>
Nov 15 01:23:58 user nova-compute[74880]:   </sysinfo>
Nov 15 01:23:58 user nova-compute[74880]:   <os>
Nov 15 01:23:58 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:23:58 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:23:58 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:23:58 user nova-compute[74880]:   </os>
Nov 15 01:23:58 user nova-compute[74880]:   <features>
Nov 15 01:23:58 user nova-compute[74880]:     <acpi/>
Nov 15 01:23:58 user nova-compute[74880]:     <apic/>
Nov 15 01:23:58 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:23:58 user nova-compute[74880]:   </features>
Nov 15 01:23:58 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:23:58 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:23:58 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:23:58 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:23:58 user nova-compute[74880]:   </clock>
Nov 15 01:23:58 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:23:58 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:23:58 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:23:58 user nova-compute[74880]:   </cpu>
Nov 15 01:23:58 user nova-compute[74880]:   <devices>
Nov 15 01:23:58 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:23:58 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:23:58 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk"/>
Nov 15 01:23:58 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:23:58 user nova-compute[74880]:     </disk>
Nov 15 01:23:58 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:23:58 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:23:58 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:23:58 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:23:58 user nova-compute[74880]:       <serial>1ed8b916-c70c-4ec7-8424-efb9d161d7e9</serial>
Nov 15 01:23:58 user nova-compute[74880]:     </disk>
Nov 15 01:23:58 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:23:58 user nova-compute[74880]:       <mac address="fa:16:3e:0f:db:87"/>
Nov 15 01:23:58 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:58 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:23:58 user nova-compute[74880]:       <target dev="tap6fe814ba-5e"/>
Nov 15 01:23:58 user nova-compute[74880]:     </interface>
Nov 15 01:23:58 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:23:58 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/console.log" append="off"/>
Nov 15 01:23:58 user nova-compute[74880]:     </serial>
Nov 15 01:23:58 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:23:58 user nova-compute[74880]:     <video>
Nov 15 01:23:58 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:23:58 user nova-compute[74880]:     </video>
Nov 15 01:23:58 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:23:58 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:23:58 user nova-compute[74880]:     </rng>
Nov 15 01:23:58 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:23:58 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:23:58 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:23:58 user nova-compute[74880]:     </memballoon>
Nov 15 01:23:58 user nova-compute[74880]:   </devices>
Nov 15 01:23:58 user nova-compute[74880]: </domain>
Nov 15 01:23:58 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG os_vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bece979d-ffd4-57dd-99bd-cdc91472098b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fe814ba-5e, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fe814ba-5e, col_values=(('qos', UUID('50d826b1-2e35-452c-bf7f-f765d90d9a99')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fe814ba-5e, col_values=(('external_ids', {'iface-id': '6fe814ba-5ec3-4038-9d2e-694980cd4ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:db:87', 'vm-uuid': '00eda474-3fbc-45ce-8986-6e8cbb90bd2d'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:23:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:58 user nova-compute[74880]: INFO os_vif [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e')
Nov 15 01:23:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:23:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance spawned successfully.
Nov 15 01:23:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-e9c46475-84ac-456d-83bb-7476a8af6195 req-f4a838fe-1a29-49a8-bd3d-b988bec8bc2f service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e9c46475-84ac-456d-83bb-7476a8af6195 req-f4a838fe-1a29-49a8-bd3d-b988bec8bc2f service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e9c46475-84ac-456d-83bb-7476a8af6195 req-f4a838fe-1a29-49a8-bd3d-b988bec8bc2f service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e9c46475-84ac-456d-83bb-7476a8af6195 req-f4a838fe-1a29-49a8-bd3d-b988bec8bc2f service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-e9c46475-84ac-456d-83bb-7476a8af6195 req-f4a838fe-1a29-49a8-bd3d-b988bec8bc2f service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:23:59 user nova-compute[74880]: WARNING nova.compute.manager [req-e9c46475-84ac-456d-83bb-7476a8af6195 req-f4a838fe-1a29-49a8-bd3d-b988bec8bc2f service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 01:23:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d75ea714-a128-4756-95bf-72a09e320c51 tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.005s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:23:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing instance network info cache due to event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:01 user nova-compute[74880]: WARNING nova.compute.manager [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state resized and task_state resize_reverting.
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:01 user nova-compute[74880]: WARNING nova.compute.manager [req-3f4fdcc1-1282-414e-8aff-d55f9e405015 req-83158e55-75b8-4f6a-b9e5-7a73610b6ff4 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state resized and task_state resize_reverting.
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'flavor' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updated VIF entry in instance network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7b8cef4d-eb8b-42a0-b381-96b79da0ff26 req-5c3a4afd-0aff-45fa-ae3b-e2b9c099f2b5 service nova] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:01 user nova-compute[74880]: INFO nova.compute.manager [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Attaching volume 7942fb0c-2985-4efe-9022-c8e6121b4687 to /dev/vdb
Nov 15 01:24:01 user nova-compute[74880]: DEBUG os_brick.utils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c017ba2-1484-4a64-a36f-439163c276d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[04543e87-c5d6-4e3b-a0f5-e9bb1c36253b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5390e35-1a67-49a6-b6f1-39242124c3b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1aa4d-135e-4ca6-b0fa-5b417bdf8579]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:24:01 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:24:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b0b520-501c-4dd0-a578-af1eb8380fe6]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG os_brick.utils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating existing volume attachment record: e5442e6c-bcdb-42df-bc53-64b7f2f936f3 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:24:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance running successfully.
Nov 15 01:24:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] finish_revert_migration finished successfully. {{(pid=74880) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 01:24:02 user nova-compute[74880]: INFO nova.compute.manager [None req-9b2393ce-137e-4eac-9586-24963339be92 tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance to original state: 'active'
Nov 15 01:24:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZHeziN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:24:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:24:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:24:06 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a73ef3-ad99-4d77-935b-50e33f335859]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:24:06 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eae8ff-7339-4595-b1cc-d97af593f750]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687] added
Nov 15 01:24:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7ff494-9754-4a8f-95b2-7751c8378011]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be3fecd-28e3-4e3f-9a87-1597b314c0b2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PlZHeziN {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PlZHeziN" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7f69e-841c-4839-89ff-031f9de6fcc5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PlZHeziN'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e973fc59-3d3a-438a-8fc2-12b783ae8221]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[476637c2-b7b7-4864-9028-22e052d9949e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[60444b5c-92f0-44d5-9e23-32f21802677c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260]
Nov 15 01:24:06 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260] successful.
Nov 15 01:24:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[daecb59d-5155-4e1d-8d1d-7b1eb6787ea9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db440d1-24b4-445a-9389-4cd32e0256f4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a184043-f3e6-4132-9a3b-44aee65c511b]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZHeziN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:24:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:24:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23232366663613830', 'path': '/dev/sde'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:24:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232366663613830', 'path': '/dev/sde'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:24:07 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'flavor' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:24:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:24:07 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:24:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:24:07 user nova-compute[74880]:   <serial>7942fb0c-2985-4efe-9022-c8e6121b4687</serial>
Nov 15 01:24:07 user nova-compute[74880]: </disk>
Nov 15 01:24:07 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:24:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:24:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:24:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:4a:23:14, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:24:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6eb3c739-07c2-4810-a55f-9b422b3ff480 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.864s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:09 user nova-compute[74880]: INFO nova.compute.manager [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Rescuing
Nov 15 01:24:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:24:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:24:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:24:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b135fd1-4b0c-4d6f-b2f0-54499d3e538b req-10ce451a-726f-42ef-90a4-1f838174024c service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b135fd1-4b0c-4d6f-b2f0-54499d3e538b req-10ce451a-726f-42ef-90a4-1f838174024c service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b135fd1-4b0c-4d6f-b2f0-54499d3e538b req-10ce451a-726f-42ef-90a4-1f838174024c service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b135fd1-4b0c-4d6f-b2f0-54499d3e538b req-10ce451a-726f-42ef-90a4-1f838174024c service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b135fd1-4b0c-4d6f-b2f0-54499d3e538b req-10ce451a-726f-42ef-90a4-1f838174024c service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:10 user nova-compute[74880]: WARNING nova.compute.manager [req-8b135fd1-4b0c-4d6f-b2f0-54499d3e538b req-10ce451a-726f-42ef-90a4-1f838174024c service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance destroyed successfully.
Nov 15 01:24:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Attempting rescue
Nov 15 01:24:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74880) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:24:10 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Creating image(s)
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'trusted_certs' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue" returned: 0 in 0.048s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'migration_context' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.base [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<88540810-db28-4f01-aa45-5cc4497214e6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Start _get_guest_xml network_info=[{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:4a:23:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'resources' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.base [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<88540810-db28-4f01-aa45-5cc4497214e6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'numa_topology' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.base [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<88540810-db28-4f01-aa45-5cc4497214e6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:24:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:24:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'vcpu_model' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.base [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<88540810-db28-4f01-aa45-5cc4497214e6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444318931',display_name='tempest-ServerRescueNegativeTestJSON-server-444318931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444318931',id=23,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8cAWldZA1oB9vFJmCXGl0c7Uog634wYXXB0/A8E9fmUE/jAvmYLSlo332qSqd2uSixKAYRepST8Ao+tynwuFe57rqk/0veuEXTnZz3p7CcgjAxs74+8a/znxsLx1WpPA==',key_name='tempest-keypair-1514010484',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-30yyp7wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=88540810-db28-4f01-aa45-5cc4497214e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:4a:23:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "vif_mac": "fa:16:3e:4a:23:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'pci_devices' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.objects.base [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Object Instance<88540810-db28-4f01-aa45-5cc4497214e6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:24:11 user nova-compute[74880]:   <uuid>88540810-db28-4f01-aa45-5cc4497214e6</uuid>
Nov 15 01:24:11 user nova-compute[74880]:   <name>instance-00000017</name>
Nov 15 01:24:11 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:24:11 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:24:11 user nova-compute[74880]:   <metadata>
Nov 15 01:24:11 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:24:11 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:24:11 user nova-compute[74880]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-444318931</nova:name>
Nov 15 01:24:11 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:24:11</nova:creationTime>
Nov 15 01:24:11 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:24:11 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:24:11 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:24:11 user nova-compute[74880]:       <nova:owner>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:user uuid="7c88b23d691c4cdc98757d0af8ab27c1">tempest-ServerRescueNegativeTestJSON-1212122190-project-member</nova:user>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:project uuid="d96e59bffc2b4c99940e4c87ad82521e">tempest-ServerRescueNegativeTestJSON-1212122190</nova:project>
Nov 15 01:24:11 user nova-compute[74880]:       </nova:owner>
Nov 15 01:24:11 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:24:11 user nova-compute[74880]:       <nova:ports>
Nov 15 01:24:11 user nova-compute[74880]:         <nova:port uuid="95133b7d-cd2d-44f6-a750-7354144aaf36">
Nov 15 01:24:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:24:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:24:11 user nova-compute[74880]:       </nova:ports>
Nov 15 01:24:11 user nova-compute[74880]:     </nova:instance>
Nov 15 01:24:11 user nova-compute[74880]:   </metadata>
Nov 15 01:24:11 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:24:11 user nova-compute[74880]:     <system>
Nov 15 01:24:11 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:24:11 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:24:11 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:24:11 user nova-compute[74880]:       <entry name="serial">88540810-db28-4f01-aa45-5cc4497214e6</entry>
Nov 15 01:24:11 user nova-compute[74880]:       <entry name="uuid">88540810-db28-4f01-aa45-5cc4497214e6</entry>
Nov 15 01:24:11 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:24:11 user nova-compute[74880]:     </system>
Nov 15 01:24:11 user nova-compute[74880]:   </sysinfo>
Nov 15 01:24:11 user nova-compute[74880]:   <os>
Nov 15 01:24:11 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:24:11 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:24:11 user nova-compute[74880]:   </os>
Nov 15 01:24:11 user nova-compute[74880]:   <features>
Nov 15 01:24:11 user nova-compute[74880]:     <acpi/>
Nov 15 01:24:11 user nova-compute[74880]:     <apic/>
Nov 15 01:24:11 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:24:11 user nova-compute[74880]:   </features>
Nov 15 01:24:11 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:24:11 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:24:11 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:24:11 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:24:11 user nova-compute[74880]:   </clock>
Nov 15 01:24:11 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:24:11 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:24:11 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:24:11 user nova-compute[74880]:   </cpu>
Nov 15 01:24:11 user nova-compute[74880]:   <devices>
Nov 15 01:24:11 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:24:11 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:24:11 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue"/>
Nov 15 01:24:11 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:24:11 user nova-compute[74880]:     </disk>
Nov 15 01:24:11 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:24:11 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:24:11 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk"/>
Nov 15 01:24:11 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:24:11 user nova-compute[74880]:     </disk>
Nov 15 01:24:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:24:11 user nova-compute[74880]:       <mac address="fa:16:3e:4a:23:14"/>
Nov 15 01:24:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:24:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:24:11 user nova-compute[74880]:       <target dev="tap95133b7d-cd"/>
Nov 15 01:24:11 user nova-compute[74880]:     </interface>
Nov 15 01:24:11 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:24:11 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/console.log" append="off"/>
Nov 15 01:24:11 user nova-compute[74880]:     </serial>
Nov 15 01:24:11 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:24:11 user nova-compute[74880]:     <video>
Nov 15 01:24:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:24:11 user nova-compute[74880]:     </video>
Nov 15 01:24:11 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:24:11 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:24:11 user nova-compute[74880]:     </rng>
Nov 15 01:24:11 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:24:11 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:24:11 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:24:11 user nova-compute[74880]:     </memballoon>
Nov 15 01:24:11 user nova-compute[74880]:   </devices>
Nov 15 01:24:11 user nova-compute[74880]: </domain>
Nov 15 01:24:11 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:24:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance destroyed successfully.
Nov 15 01:24:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] No VIF found with MAC fa:16:3e:4a:23:14, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:24:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:12 user nova-compute[74880]: WARNING nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:12 user nova-compute[74880]: WARNING nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:12 user nova-compute[74880]: WARNING nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:12 user nova-compute[74880]: WARNING nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:12 user nova-compute[74880]: WARNING nova.compute.manager [req-cb98c2ad-7c3b-4228-a3db-e526609e1146 req-7696212e-66a0-4d06-a959-df90e38d13dd service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:14 user nova-compute[74880]: WARNING nova.compute.manager [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:14 user nova-compute[74880]: WARNING nova.compute.manager [req-9b5b502c-daa8-4190-8c92-35b3abe6f634 req-12feec24-0185-4364-9a87-85485b4a7235 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state active and task_state rescuing.
Nov 15 01:24:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e9c60e1d-16bd-432e-a060-c5cd0b667c4d tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:16 user nova-compute[74880]: INFO nova.compute.manager [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Terminating instance
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b98a0c0-8bc1-49d7-ac77-ab5fa9e7ef4a req-dc3d7ea9-d6ed-4def-8afe-0cbfe8315df2 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-vif-unplugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b98a0c0-8bc1-49d7-ac77-ab5fa9e7ef4a req-dc3d7ea9-d6ed-4def-8afe-0cbfe8315df2 service nova] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b98a0c0-8bc1-49d7-ac77-ab5fa9e7ef4a req-dc3d7ea9-d6ed-4def-8afe-0cbfe8315df2 service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b98a0c0-8bc1-49d7-ac77-ab5fa9e7ef4a req-dc3d7ea9-d6ed-4def-8afe-0cbfe8315df2 service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b98a0c0-8bc1-49d7-ac77-ab5fa9e7ef4a req-dc3d7ea9-d6ed-4def-8afe-0cbfe8315df2 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] No waiting events found dispatching network-vif-unplugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b98a0c0-8bc1-49d7-ac77-ab5fa9e7ef4a req-dc3d7ea9-d6ed-4def-8afe-0cbfe8315df2 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-vif-unplugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:24:16 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Instance destroyed successfully.
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lazy-loading 'resources' on Instance uuid 1fc1c56b-bf28-4060-80c8-1552e2632bdd {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-660748554',display_name='tempest-VolumesActionsTest-instance-660748554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-660748554',id=24,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:22:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9227eed50873467fa2d81608d5f77978',ramdisk_id='',reservation_id='r-qm45qkxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-565390894',owner_user_name='tempest-VolumesActionsTest-565390894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:22:32Z,user_data=None,user_id='8105ea094961417982de5311ecff7635',uuid=1fc1c56b-bf28-4060-80c8-1552e2632bdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converting VIF {"id": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "address": "fa:16:3e:90:2a:7e", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaebe45dd-d4", "ovs_interfaceid": "aebe45dd-d4eb-423a-a29d-df6a5e55d0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG os_vif [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaebe45dd-d4, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6852ef77-5381-4153-8b09-c1446eff568c) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:24:16 user nova-compute[74880]: INFO os_vif [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2a:7e,bridge_name='br-int',has_traffic_filtering=True,id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaebe45dd-d4')
Nov 15 01:24:16 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Deleting instance files /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd_del
Nov 15 01:24:16 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Deletion of /opt/stack/data/nova/instances/1fc1c56b-bf28-4060-80c8-1552e2632bdd_del complete
Nov 15 01:24:16 user nova-compute[74880]: INFO nova.compute.manager [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 15 01:24:16 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:24:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:17 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Took 0.53 seconds to deallocate network for instance.
Nov 15 01:24:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-c339f5be-935e-42bc-9005-3a8eb250ad99 req-1aae07f8-44a8-4d8d-a6b3-d0fd619ce3eb service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-vif-deleted-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:17 user nova-compute[74880]: INFO nova.compute.manager [req-c339f5be-935e-42bc-9005-3a8eb250ad99 req-1aae07f8-44a8-4d8d-a6b3-d0fd619ce3eb service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Neutron deleted interface aebe45dd-d4eb-423a-a29d-df6a5e55d0a4; detaching it from the instance and deleting it from the info cache
Nov 15 01:24:17 user nova-compute[74880]: DEBUG nova.network.neutron [req-c339f5be-935e-42bc-9005-3a8eb250ad99 req-1aae07f8-44a8-4d8d-a6b3-d0fd619ce3eb service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-c339f5be-935e-42bc-9005-3a8eb250ad99 req-1aae07f8-44a8-4d8d-a6b3-d0fd619ce3eb service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Detach interface failed, port_id=aebe45dd-d4eb-423a-a29d-df6a5e55d0a4, reason: Instance 1fc1c56b-bf28-4060-80c8-1552e2632bdd could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:24:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:17 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Deleted allocations for instance 1fc1c56b-bf28-4060-80c8-1552e2632bdd
Nov 15 01:24:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0edb6344-7a49-42af-86c3-e1d77e7ae754 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f7675007-8035-4fa7-85af-7050d1e2794e req-a047a05b-9f27-408f-93d4-c39dd1a31479 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received event network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f7675007-8035-4fa7-85af-7050d1e2794e req-a047a05b-9f27-408f-93d4-c39dd1a31479 service nova] Acquiring lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f7675007-8035-4fa7-85af-7050d1e2794e req-a047a05b-9f27-408f-93d4-c39dd1a31479 service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f7675007-8035-4fa7-85af-7050d1e2794e req-a047a05b-9f27-408f-93d4-c39dd1a31479 service nova] Lock "1fc1c56b-bf28-4060-80c8-1552e2632bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-f7675007-8035-4fa7-85af-7050d1e2794e req-a047a05b-9f27-408f-93d4-c39dd1a31479 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] No waiting events found dispatching network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:18 user nova-compute[74880]: WARNING nova.compute.manager [req-f7675007-8035-4fa7-85af-7050d1e2794e req-a047a05b-9f27-408f-93d4-c39dd1a31479 service nova] [instance: 1fc1c56b-bf28-4060-80c8-1552e2632bdd] Received unexpected event network-vif-plugged-aebe45dd-d4eb-423a-a29d-df6a5e55d0a4 for instance with vm_state deleted and task_state None.
Nov 15 01:24:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:24:27 user nova-compute[74880]: INFO nova.compute.manager [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] instance snapshotting
Nov 15 01:24:27 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Beginning live snapshot process
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7nua7pr5/1dda2e724bbc49c593aebe45c3b359bc.delta 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7nua7pr5/1dda2e724bbc49c593aebe45c3b359bc.delta 1073741824" returned: 0 in 0.054s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:28 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 01:24:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:24:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] COPY block job progress, current cursor: 23330816 final cursor: 75563008 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:24:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:24:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 01:24:29 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:24:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7nua7pr5/1dda2e724bbc49c593aebe45c3b359bc.delta /opt/stack/data/nova/instances/snapshots/tmp7nua7pr5/1dda2e724bbc49c593aebe45c3b359bc {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7nua7pr5/1dda2e724bbc49c593aebe45c3b359bc.delta /opt/stack/data/nova/instances/snapshots/tmp7nua7pr5/1dda2e724bbc49c593aebe45c3b359bc" returned: 0 in 0.842s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Snapshot extracted, beginning image upload
Nov 15 01:24:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:33 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Snapshot image upload complete
Nov 15 01:24:33 user nova-compute[74880]: INFO nova.compute.manager [None req-e528c6ed-5629-4f5f-8bea-b24f100e112a tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Took 6.12 seconds to snapshot the instance on the hypervisor.
Nov 15 01:24:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:24:34 user nova-compute[74880]: INFO nova.compute.claims [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Claim successful on node user
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.network.neutron [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:24:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.policy [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8269824ea172423b96ad3d29ff63ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386aadc3b4fe4658b08779ebdb482b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:24:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Creating image(s)
Nov 15 01:24:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "/opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "/opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "/opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "4af5310b53f2e5f20c2481b26a738874b8a5eccf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "4af5310b53f2e5f20c2481b26a738874b8a5eccf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG nova.network.neutron [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Successfully created port: 6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG nova.virt.images [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] d914e26f-c82b-484a-ad1d-7204ae80ecd6 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:24:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.part /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.part /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.converted" returned: 0 in 0.396s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Successfully updated port: 6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquired lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-changed-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Refreshing instance network info cache due to event network-changed-6c622032-85ad-4e3a-a024-a930e3231611. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] Acquiring lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "4af5310b53f2e5f20c2481b26a738874b8a5eccf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.923s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "4af5310b53f2e5f20c2481b26a738874b8a5eccf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "4af5310b53f2e5f20c2481b26a738874b8a5eccf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updating instance_info_cache with network_info: [{"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf --force-share --output=json" returned: 0 in 0.205s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:37 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf,backing_fmt=raw /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Releasing lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Instance network_info: |[{"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf,backing_fmt=raw /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk 1073741824" returned: 0 in 0.121s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] Acquired lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Refreshing network info cache for port 6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "4af5310b53f2e5f20c2481b26a738874b8a5eccf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Ensure instance console log exists: /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Start _get_guest_xml network_info=[{"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7f4fa158767e0a9b5ce7c5d481db9d65',container_format='bare',created_at=2023-11-15T01:24:27Z,direct_url=<?>,disk_format='qcow2',id=d914e26f-c82b-484a-ad1d-7204ae80ecd6,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1863494189',owner='386aadc3b4fe4658b08779ebdb482b5f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T01:24:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'd914e26f-c82b-484a-ad1d-7204ae80ecd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:24:38 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:24:38 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7f4fa158767e0a9b5ce7c5d481db9d65',container_format='bare',created_at=2023-11-15T01:24:27Z,direct_url=<?>,disk_format='qcow2',id=d914e26f-c82b-484a-ad1d-7204ae80ecd6,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1863494189',owner='386aadc3b4fe4658b08779ebdb482b5f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T01:24:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-966913070',display_name='tempest-TestStampPattern-server-966913070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-966913070',id=28,image_ref='d914e26f-c82b-484a-ad1d-7204ae80ecd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG95KHprtUgb5ymRCd6lTxiyqEUi8lMu7mCWG7VewMJuAVjD8xz4kDJVqxJmD8p0wXX5Qzb1MHKG7wVCeJwshyMqg3BWDFP+wfFDMHkCQaSz9lW4qeUs6021F3fVH4Cyyw==',key_name='tempest-TestStampPattern-1850115214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386aadc3b4fe4658b08779ebdb482b5f',ramdisk_id='',reservation_id='r-q3oynv29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ad07de27-3fd2-466c-a066-0b2883bf68a8',image_min_disk='1',image_min_ram='0',image_owner_id='386aadc3b4fe4658b08779ebdb482b5f',image_owner_project_name='tempest-TestStampPattern-1899706846',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1899706846-project-member',image_user_id='8269824ea172423b96ad3d29ff63ed2f',network_allocated='True',owner_project_name='tempest-TestStampPattern-1899706846',owner_user_name='tempest-TestStampPattern-1899706846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:24:36Z,user_data=None,user_id='8269824ea172423b96ad3d29ff63ed2f',uuid=97877ac2-ab65-413a-96a1-928847c8a0a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converting VIF {"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.objects.instance [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'pci_devices' on Instance uuid 97877ac2-ab65-413a-96a1-928847c8a0a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:24:38 user nova-compute[74880]:   <uuid>97877ac2-ab65-413a-96a1-928847c8a0a8</uuid>
Nov 15 01:24:38 user nova-compute[74880]:   <name>instance-0000001c</name>
Nov 15 01:24:38 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:24:38 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:24:38 user nova-compute[74880]:   <metadata>
Nov 15 01:24:38 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:24:38 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:24:38 user nova-compute[74880]:       <nova:name>tempest-TestStampPattern-server-966913070</nova:name>
Nov 15 01:24:38 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:24:38</nova:creationTime>
Nov 15 01:24:38 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:24:38 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:24:38 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:24:38 user nova-compute[74880]:       <nova:owner>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:user uuid="8269824ea172423b96ad3d29ff63ed2f">tempest-TestStampPattern-1899706846-project-member</nova:user>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:project uuid="386aadc3b4fe4658b08779ebdb482b5f">tempest-TestStampPattern-1899706846</nova:project>
Nov 15 01:24:38 user nova-compute[74880]:       </nova:owner>
Nov 15 01:24:38 user nova-compute[74880]:       <nova:root type="image" uuid="d914e26f-c82b-484a-ad1d-7204ae80ecd6"/>
Nov 15 01:24:38 user nova-compute[74880]:       <nova:ports>
Nov 15 01:24:38 user nova-compute[74880]:         <nova:port uuid="6c622032-85ad-4e3a-a024-a930e3231611">
Nov 15 01:24:38 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:24:38 user nova-compute[74880]:         </nova:port>
Nov 15 01:24:38 user nova-compute[74880]:       </nova:ports>
Nov 15 01:24:38 user nova-compute[74880]:     </nova:instance>
Nov 15 01:24:38 user nova-compute[74880]:   </metadata>
Nov 15 01:24:38 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:24:38 user nova-compute[74880]:     <system>
Nov 15 01:24:38 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:24:38 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:24:38 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:24:38 user nova-compute[74880]:       <entry name="serial">97877ac2-ab65-413a-96a1-928847c8a0a8</entry>
Nov 15 01:24:38 user nova-compute[74880]:       <entry name="uuid">97877ac2-ab65-413a-96a1-928847c8a0a8</entry>
Nov 15 01:24:38 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:24:38 user nova-compute[74880]:     </system>
Nov 15 01:24:38 user nova-compute[74880]:   </sysinfo>
Nov 15 01:24:38 user nova-compute[74880]:   <os>
Nov 15 01:24:38 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:24:38 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:24:38 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:24:38 user nova-compute[74880]:   </os>
Nov 15 01:24:38 user nova-compute[74880]:   <features>
Nov 15 01:24:38 user nova-compute[74880]:     <acpi/>
Nov 15 01:24:38 user nova-compute[74880]:     <apic/>
Nov 15 01:24:38 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:24:38 user nova-compute[74880]:   </features>
Nov 15 01:24:38 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:24:38 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:24:38 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:24:38 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:24:38 user nova-compute[74880]:   </clock>
Nov 15 01:24:38 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:24:38 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:24:38 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:24:38 user nova-compute[74880]:   </cpu>
Nov 15 01:24:38 user nova-compute[74880]:   <devices>
Nov 15 01:24:38 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:24:38 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:24:38 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk"/>
Nov 15 01:24:38 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:24:38 user nova-compute[74880]:     </disk>
Nov 15 01:24:38 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:24:38 user nova-compute[74880]:       <mac address="fa:16:3e:56:05:68"/>
Nov 15 01:24:38 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:24:38 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:24:38 user nova-compute[74880]:       <target dev="tap6c622032-85"/>
Nov 15 01:24:38 user nova-compute[74880]:     </interface>
Nov 15 01:24:38 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:24:38 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/console.log" append="off"/>
Nov 15 01:24:38 user nova-compute[74880]:     </serial>
Nov 15 01:24:38 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:24:38 user nova-compute[74880]:     <video>
Nov 15 01:24:38 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:24:38 user nova-compute[74880]:     </video>
Nov 15 01:24:38 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:24:38 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:24:38 user nova-compute[74880]:     </rng>
Nov 15 01:24:38 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:24:38 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:24:38 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:24:38 user nova-compute[74880]:     </memballoon>
Nov 15 01:24:38 user nova-compute[74880]:   </devices>
Nov 15 01:24:38 user nova-compute[74880]: </domain>
Nov 15 01:24:38 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-966913070',display_name='tempest-TestStampPattern-server-966913070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-966913070',id=28,image_ref='d914e26f-c82b-484a-ad1d-7204ae80ecd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG95KHprtUgb5ymRCd6lTxiyqEUi8lMu7mCWG7VewMJuAVjD8xz4kDJVqxJmD8p0wXX5Qzb1MHKG7wVCeJwshyMqg3BWDFP+wfFDMHkCQaSz9lW4qeUs6021F3fVH4Cyyw==',key_name='tempest-TestStampPattern-1850115214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386aadc3b4fe4658b08779ebdb482b5f',ramdisk_id='',reservation_id='r-q3oynv29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ad07de27-3fd2-466c-a066-0b2883bf68a8',image_min_disk='1',image_min_ram='0',image_owner_id='386aadc3b4fe4658b08779ebdb482b5f',image_owner_project_name='tempest-TestStampPattern-1899706846',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1899706846-project-member',image_user_id='8269824ea172423b96ad3d29ff63ed2f',network_allocated='True',owner_project_name='tempest-TestStampPattern-1899706846',owner_user_name='tempest-TestStampPattern-1899706846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:24:36Z,user_data=None,user_id='8269824ea172423b96ad3d29ff63ed2f',uuid=97877ac2-ab65-413a-96a1-928847c8a0a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converting VIF {"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG os_vif [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1eac766e-b658-5cbe-a8a7-4c01e46afa90', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c622032-85, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c622032-85, col_values=(('qos', UUID('bca51c23-a782-437f-8638-31f74d6be1f4')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c622032-85, col_values=(('external_ids', {'iface-id': '6c622032-85ad-4e3a-a024-a930e3231611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:05:68', 'vm-uuid': '97877ac2-ab65-413a-96a1-928847c8a0a8'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:38 user nova-compute[74880]: INFO os_vif [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85')
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No VIF found with MAC fa:16:3e:56:05:68, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updated VIF entry in instance network info cache for port 6c622032-85ad-4e3a-a024-a930e3231611. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updating instance_info_cache with network_info: [{"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2533a0f0-8007-423b-91cd-3759d3d44591 req-d57b5b3d-afa3-4e79-905f-5819e427a7c8 service nova] Releasing lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:24:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-f9b5aa11-704b-4f16-954e-f0f6a2a09de5 req-65c5ac91-3c62-4e28-95ac-13c240131567 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f9b5aa11-704b-4f16-954e-f0f6a2a09de5 req-65c5ac91-3c62-4e28-95ac-13c240131567 service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f9b5aa11-704b-4f16-954e-f0f6a2a09de5 req-65c5ac91-3c62-4e28-95ac-13c240131567 service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f9b5aa11-704b-4f16-954e-f0f6a2a09de5 req-65c5ac91-3c62-4e28-95ac-13c240131567 service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-f9b5aa11-704b-4f16-954e-f0f6a2a09de5 req-65c5ac91-3c62-4e28-95ac-13c240131567 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:40 user nova-compute[74880]: WARNING nova.compute.manager [req-f9b5aa11-704b-4f16-954e-f0f6a2a09de5 req-65c5ac91-3c62-4e28-95ac-13c240131567 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received unexpected event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with vm_state building and task_state spawning.
Nov 15 01:24:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:24:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:24:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Instance spawned successfully.
Nov 15 01:24:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:24:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:24:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:24:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:41 user nova-compute[74880]: INFO nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 15 01:24:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:24:42 user nova-compute[74880]: INFO nova.compute.manager [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Took 7.07 seconds to build instance.
Nov 15 01:24:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd7488fd-32f1-4d09-a405-690a55048efd tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.249s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-439aa5cf-e79b-4768-bc2d-94c6ef3f7cc9 req-c16a7c55-d85a-4ec5-9a1e-8d0cc9e5021b service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-439aa5cf-e79b-4768-bc2d-94c6ef3f7cc9 req-c16a7c55-d85a-4ec5-9a1e-8d0cc9e5021b service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-439aa5cf-e79b-4768-bc2d-94c6ef3f7cc9 req-c16a7c55-d85a-4ec5-9a1e-8d0cc9e5021b service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-439aa5cf-e79b-4768-bc2d-94c6ef3f7cc9 req-c16a7c55-d85a-4ec5-9a1e-8d0cc9e5021b service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-439aa5cf-e79b-4768-bc2d-94c6ef3f7cc9 req-c16a7c55-d85a-4ec5-9a1e-8d0cc9e5021b service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:42 user nova-compute[74880]: WARNING nova.compute.manager [req-439aa5cf-e79b-4768-bc2d-94c6ef3f7cc9 req-c16a7c55-d85a-4ec5-9a1e-8d0cc9e5021b service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received unexpected event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with vm_state active and task_state None.
Nov 15 01:24:42 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:24:42 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:43 user nova-compute[74880]: INFO nova.compute.manager [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Terminating instance
Nov 15 01:24:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bd726ae-bb78-4c9b-bea6-1fa3941516dc req-bd7b8e51-77da-4645-b442-c353479a9f59 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-unplugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bd726ae-bb78-4c9b-bea6-1fa3941516dc req-bd7b8e51-77da-4645-b442-c353479a9f59 service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bd726ae-bb78-4c9b-bea6-1fa3941516dc req-bd7b8e51-77da-4645-b442-c353479a9f59 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9bd726ae-bb78-4c9b-bea6-1fa3941516dc req-bd7b8e51-77da-4645-b442-c353479a9f59 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bd726ae-bb78-4c9b-bea6-1fa3941516dc req-bd7b8e51-77da-4645-b442-c353479a9f59 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-unplugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-9bd726ae-bb78-4c9b-bea6-1fa3941516dc req-bd7b8e51-77da-4645-b442-c353479a9f59 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-unplugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:24:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Instance destroyed successfully.
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lazy-loading 'resources' on Instance uuid 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312268747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-384987413',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMcAk9YFgMHc5QC18Zrh41amlCdbanvex0qu/dL79E4oEGET1gLpaDiVdfhJa9wrX/Cm9tleeuTYssjuZ3UjVPqkNb14qffQW15yrfOVUo9LgIFTkjeN4+fRuz5u+VKkA==',key_name='tempest-keypair-1641009201',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eda993e255245fcbfe4e3044fbe51ce',ramdisk_id='',reservation_id='r-gi0obfpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-867042238',owner_user_name='tempest-ServerActionsV293TestJSON-867042238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d027731a44c4b4eafba314166bd6006',uuid=2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converting VIF {"id": "c826f62f-3a02-45e7-b066-392cbd32014e", "address": "fa:16:3e:4e:ac:f1", "network": {"id": "7a27f043-3bb5-40f5-a541-d78cc65cb70a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1186242294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eda993e255245fcbfe4e3044fbe51ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc826f62f-3a", "ovs_interfaceid": "c826f62f-3a02-45e7-b066-392cbd32014e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_vif [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc826f62f-3a, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfd1928c-a6fd-4815-b61c-8f55b69748f7) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:44 user nova-compute[74880]: INFO os_vif [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:ac:f1,bridge_name='br-int',has_traffic_filtering=True,id=c826f62f-3a02-45e7-b066-392cbd32014e,network=Network(7a27f043-3bb5-40f5-a541-d78cc65cb70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc826f62f-3a')
Nov 15 01:24:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umrKJaHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:24:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac94d562-ec61-41e4-ba45-a155a2cc9f74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:24:44 user nova-compute[74880]: No targets found.
Nov 15 01:24:44 user nova-compute[74880]: iSNS:
Nov 15 01:24:44 user nova-compute[74880]: No targets found.
Nov 15 01:24:44 user nova-compute[74880]: STATIC:
Nov 15 01:24:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:24:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:24:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:24:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086
Nov 15 01:24:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:24:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:24:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:24:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:24:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:24:44 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:24:44 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:24:44 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:24:44 user nova-compute[74880]: FIRMWARE:
Nov 15 01:24:44 user nova-compute[74880]: No targets found.
Nov 15 01:24:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:24:44 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:24:44 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17f63b-d80e-472a-bf3f-cf072a81112f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc10aa-b516-4861-9895-5e251ee11cde]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06b1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed44c2-fb9c-4757-ac61-4c0ba94598c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bce196-0cca-42bc-8bde-156e7bd55534]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[472646da-d78e-4f79-b6bb-8df257d84dd7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1312a-3a65-4096-aebb-2d758e4b8e59]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4ed364fc-f472d20d2054df38', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ed364fc', '/dev/disk/by-id/scsi-26634373264323064') {{(pid=85948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e4c54b-c62f-4a04-a9c8-a9bd0bdcf062]: (4, None) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba52e427-8fb0-43cb-acab-606623deebe0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4dcec-e9c2-4224-801e-7317acdd0631]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260]
Nov 15 01:24:44 user nova-compute[74880]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086, portal: 172.16.0.220,3260] successful.
Nov 15 01:24:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c666dcc3-5e17-4d17-9705-7380b3794086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67245f7-96c5-4520-b6e1-5175f2ad4dac]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] <== disconnect_volume: return (369ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:24:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Deleting instance files /opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f_del
Nov 15 01:24:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Deletion of /opt/stack/data/nova/instances/2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f_del complete
Nov 15 01:24:45 user nova-compute[74880]: INFO nova.compute.manager [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:45 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Took 0.62 seconds to deallocate network for instance.
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:24:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] Acquiring lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] No waiting events found dispatching network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:24:46 user nova-compute[74880]: WARNING nova.compute.manager [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received unexpected event network-vif-plugged-c826f62f-3a02-45e7-b066-392cbd32014e for instance with vm_state active and task_state deleting.
Nov 15 01:24:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-07845fde-61f0-4842-b6ae-37875b630429 req-d4cb72a9-ddd9-40cd-81bb-f0025616cd14 service nova] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Received event network-vif-deleted-c826f62f-3a02-45e7-b066-392cbd32014e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:46 user nova-compute[74880]: INFO nova.compute.manager [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Took 0.78 seconds to detach 1 volumes for instance.
Nov 15 01:24:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] [instance: 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f] Deleting volume: c666dcc3-5e17-4d17-9705-7380b3794086 {{(pid=74880) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.603s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.101s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:47 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Deleted allocations for instance 2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a5469cea-4c4c-4a32-936c-30cb59b48aad tempest-ServerActionsV293TestJSON-867042238 tempest-ServerActionsV293TestJSON-867042238-project-member] Lock "2ecc3af6-98b2-4e5d-8475-19cf6ec2e30f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.038s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:24:50 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:24:50 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:24:50 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=25.332019805908203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 88540810-db28-4f01-aa45-5cc4497214e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 97877ac2-ab65-413a-96a1-928847c8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:24:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:24:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:24:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:24:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-changed-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Refreshing instance network info cache due to event network-changed-8d49b499-57bd-4d6e-a446-5cf63617047d. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] Acquiring lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] Acquired lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Refreshing network info cache for port 8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'flavor' on Instance uuid 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:53 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Ignoring supplied device name: /dev/vdb
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:24:53 user nova-compute[74880]: INFO nova.compute.manager [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Attaching volume c7257651-3045-4ea2-ac20-f6c85904d6eb to /dev/vdb
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updated VIF entry in instance network info cache for port 8d49b499-57bd-4d6e-a446-5cf63617047d. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updating instance_info_cache with network_info: [{"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-595ba2d5-2266-4095-8f36-74ced6bed1d6 req-a761fd21-b8d0-4d53-9bc8-8a7219dde9c9 service nova] Releasing lock "refresh_cache-3a37e5f8-0c79-4a15-bef1-43a12b7b8770" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG os_brick.utils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7077214-5a92-4160-8ea6-65641110a36d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2459ad44-df60-48ee-856a-2871389aec25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f6f52-7973-46d8-9950-63f56b204286]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585b76b-db81-4d91-958a-ec7c2ecfda55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:24:53 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:24:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5d8ae-d0a0-4af2-95c2-6d34c5dfd66d]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG os_brick.utils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:24:53 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updating existing volume attachment record: c5ff2d70-3375-43a2-a60e-338ad8acb7cc {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:24:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:24:57 user nova-compute[74880]: INFO nova.compute.manager [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] instance snapshotting
Nov 15 01:24:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Beginning live snapshot process
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBoXGFur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:24:58 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:24:58 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:24:58 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[180a8842-15a7-485b-8155-fe864b39b8c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:24:58 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ee030-c0bc-438f-b3aa-000c7072bf7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb] added
Nov 15 01:24:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fde5df-91d6-468b-9367-c5ae509aedec]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68e5e0-cf7a-43f8-8be6-cd578b7439fc]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBoXGFur {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBoXGFur" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bdd1ca-9a06-45cd-a9b2-9fc50699dde4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBoXGFur'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1486e235-1e35-467d-9c3f-d96626a818f4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaed459-3e0f-4009-b0e9-4fc0e1b62e08]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ceb93-e1aa-4154-b53b-8111689e0420]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260]
Nov 15 01:24:58 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260] successful.
Nov 15 01:24:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22c3b97-5a17-4b32-91ae-dc2bda60b9d5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[986aa396-c197-4feb-b59e-89516767ae5b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:24:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:24:58 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:24:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e6261d-a0c8-49d9-997d-fc400c93491d]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBoXGFur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk4uv30og/20701bd485ef4bdb80888bb37bafc818.delta 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:24:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk4uv30og/20701bd485ef4bdb80888bb37bafc818.delta 1073741824" returned: 0 in 0.048s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:24:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 01:24:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23665363961373938', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665363961373938', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'flavor' on Instance uuid 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:24:59 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:24:59 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:24:59 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:24:59 user nova-compute[74880]:   <serial>c7257651-3045-4ea2-ac20-f6c85904d6eb</serial>
Nov 15 01:24:59 user nova-compute[74880]: </disk>
Nov 15 01:24:59 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:24:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] COPY block job progress, current cursor: 41746432 final cursor: 75497472 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] No VIF found with MAC fa:16:3e:83:c3:e0, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b2268788-9330-4689-bc03-0528435ee0ef tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.725s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:25:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 01:25:00 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk4uv30og/20701bd485ef4bdb80888bb37bafc818.delta /opt/stack/data/nova/instances/snapshots/tmpk4uv30og/20701bd485ef4bdb80888bb37bafc818 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk4uv30og/20701bd485ef4bdb80888bb37bafc818.delta /opt/stack/data/nova/instances/snapshots/tmpk4uv30og/20701bd485ef4bdb80888bb37bafc818" returned: 0 in 0.255s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Snapshot extracted, beginning image upload
Nov 15 01:25:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Snapshot image upload complete
Nov 15 01:25:03 user nova-compute[74880]: INFO nova.compute.manager [None req-fbc67cc0-b64c-48c7-b388-f21bce8a4eb1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Took 5.40 seconds to snapshot the instance on the hypervisor.
Nov 15 01:25:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:07 user nova-compute[74880]: INFO nova.compute.manager [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Detaching volume c7257651-3045-4ea2-ac20-f6c85904d6eb
Nov 15 01:25:07 user nova-compute[74880]: INFO nova.virt.block_device [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Attempting to driver detach volume c7257651-3045-4ea2-ac20-f6c85904d6eb from mountpoint /dev/vdb
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Attempting to detach device vdb from instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:25:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:25:07 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:25:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:25:07 user nova-compute[74880]:   <serial>c7257651-3045-4ea2-ac20-f6c85904d6eb</serial>
Nov 15 01:25:07 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:25:07 user nova-compute[74880]: </disk>
Nov 15 01:25:07 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:25:07 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully detached device vdb from instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 from the persistent domain config.
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:25:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:25:07 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:25:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:25:07 user nova-compute[74880]:   <serial>c7257651-3045-4ea2-ac20-f6c85904d6eb</serial>
Nov 15 01:25:07 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:25:07 user nova-compute[74880]: </disk>
Nov 15 01:25:07 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:25:07 user nova-compute[74880]: INFO nova.compute.claims [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Claim successful on node user
Nov 15 01:25:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:25:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.policy [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8105ea094961417982de5311ecff7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9227eed50873467fa2d81608d5f77978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:25:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Creating image(s)
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "/opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "/opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "/opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk 1073741824" returned: 0 in 0.054s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Successfully created port: 54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Cannot resize image /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Ensure instance console log exists: /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Successfully updated port: 54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "refresh_cache-5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquired lock "refresh_cache-5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.compute.manager [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-changed-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.compute.manager [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Refreshing instance network info cache due to event network-changed-54073e75-8725-41be-9f44-4bfc22410dc1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] Acquiring lock "refresh_cache-5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Updating instance_info_cache with network_info: [{"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Releasing lock "refresh_cache-5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Instance network_info: |[{"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] Acquired lock "refresh_cache-5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Refreshing network info cache for port 54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Start _get_guest_xml network_info=[{"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:25:10 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:25:10 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-54928049',display_name='tempest-VolumesActionsTest-instance-54928049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-54928049',id=29,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9227eed50873467fa2d81608d5f77978',ramdisk_id='',reservation_id='r-lzsvdbez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-565390894',owner_user_name='tempest-VolumesActionsTest-565390894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:25:08Z,user_data=None,user_id='8105ea094961417982de5311ecff7635',uuid=5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converting VIF {"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lazy-loading 'pci_devices' on Instance uuid 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:25:10 user nova-compute[74880]:   <uuid>5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7</uuid>
Nov 15 01:25:10 user nova-compute[74880]:   <name>instance-0000001d</name>
Nov 15 01:25:10 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:25:10 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:25:10 user nova-compute[74880]:   <metadata>
Nov 15 01:25:10 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:25:10 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:25:10 user nova-compute[74880]:       <nova:name>tempest-VolumesActionsTest-instance-54928049</nova:name>
Nov 15 01:25:10 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:25:10</nova:creationTime>
Nov 15 01:25:10 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:25:10 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:25:10 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:25:10 user nova-compute[74880]:       <nova:owner>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:user uuid="8105ea094961417982de5311ecff7635">tempest-VolumesActionsTest-565390894-project-member</nova:user>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:project uuid="9227eed50873467fa2d81608d5f77978">tempest-VolumesActionsTest-565390894</nova:project>
Nov 15 01:25:10 user nova-compute[74880]:       </nova:owner>
Nov 15 01:25:10 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:25:10 user nova-compute[74880]:       <nova:ports>
Nov 15 01:25:10 user nova-compute[74880]:         <nova:port uuid="54073e75-8725-41be-9f44-4bfc22410dc1">
Nov 15 01:25:10 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:25:10 user nova-compute[74880]:         </nova:port>
Nov 15 01:25:10 user nova-compute[74880]:       </nova:ports>
Nov 15 01:25:10 user nova-compute[74880]:     </nova:instance>
Nov 15 01:25:10 user nova-compute[74880]:   </metadata>
Nov 15 01:25:10 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:25:10 user nova-compute[74880]:     <system>
Nov 15 01:25:10 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:25:10 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:25:10 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:25:10 user nova-compute[74880]:       <entry name="serial">5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7</entry>
Nov 15 01:25:10 user nova-compute[74880]:       <entry name="uuid">5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7</entry>
Nov 15 01:25:10 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:25:10 user nova-compute[74880]:     </system>
Nov 15 01:25:10 user nova-compute[74880]:   </sysinfo>
Nov 15 01:25:10 user nova-compute[74880]:   <os>
Nov 15 01:25:10 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:25:10 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:25:10 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:25:10 user nova-compute[74880]:   </os>
Nov 15 01:25:10 user nova-compute[74880]:   <features>
Nov 15 01:25:10 user nova-compute[74880]:     <acpi/>
Nov 15 01:25:10 user nova-compute[74880]:     <apic/>
Nov 15 01:25:10 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:25:10 user nova-compute[74880]:   </features>
Nov 15 01:25:10 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:25:10 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:25:10 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:25:10 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:25:10 user nova-compute[74880]:   </clock>
Nov 15 01:25:10 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:25:10 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:25:10 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:25:10 user nova-compute[74880]:   </cpu>
Nov 15 01:25:10 user nova-compute[74880]:   <devices>
Nov 15 01:25:10 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:25:10 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:25:10 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk"/>
Nov 15 01:25:10 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:25:10 user nova-compute[74880]:     </disk>
Nov 15 01:25:10 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:25:10 user nova-compute[74880]:       <mac address="fa:16:3e:bd:a7:38"/>
Nov 15 01:25:10 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:25:10 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:25:10 user nova-compute[74880]:       <target dev="tap54073e75-87"/>
Nov 15 01:25:10 user nova-compute[74880]:     </interface>
Nov 15 01:25:10 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:25:10 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/console.log" append="off"/>
Nov 15 01:25:10 user nova-compute[74880]:     </serial>
Nov 15 01:25:10 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:25:10 user nova-compute[74880]:     <video>
Nov 15 01:25:10 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:25:10 user nova-compute[74880]:     </video>
Nov 15 01:25:10 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:25:10 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:25:10 user nova-compute[74880]:     </rng>
Nov 15 01:25:10 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:25:10 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:25:10 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:25:10 user nova-compute[74880]:     </memballoon>
Nov 15 01:25:10 user nova-compute[74880]:   </devices>
Nov 15 01:25:10 user nova-compute[74880]: </domain>
Nov 15 01:25:10 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-54928049',display_name='tempest-VolumesActionsTest-instance-54928049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-54928049',id=29,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9227eed50873467fa2d81608d5f77978',ramdisk_id='',reservation_id='r-lzsvdbez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-565390894',owner_user_name='tempest-VolumesActionsTest-565390894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:25:08Z,user_data=None,user_id='8105ea094961417982de5311ecff7635',uuid=5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converting VIF {"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG os_vif [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28ce3559-a234-5379-89d5-bbcf252d185b', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54073e75-87, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54073e75-87, col_values=(('qos', UUID('d14abfcc-fa21-418e-babd-8d5fbbb2a411')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54073e75-87, col_values=(('external_ids', {'iface-id': '54073e75-8725-41be-9f44-4bfc22410dc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:a7:38', 'vm-uuid': '5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:10 user nova-compute[74880]: INFO os_vif [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87')
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] No VIF found with MAC fa:16:3e:bd:a7:38, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Updated VIF entry in instance network info cache for port 54073e75-8725-41be-9f44-4bfc22410dc1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Updating instance_info_cache with network_info: [{"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5a824626-c1ce-483b-a0a3-9b79520d44b2 req-55dec154-bf0d-4a53-baee-c07d4fc07854 service nova] Releasing lock "refresh_cache-5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-10233665-4970-4a57-9e36-45e9a75829e3 req-9d74a328-253b-4156-a8da-77003465f81d service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-10233665-4970-4a57-9e36-45e9a75829e3 req-9d74a328-253b-4156-a8da-77003465f81d service nova] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-10233665-4970-4a57-9e36-45e9a75829e3 req-9d74a328-253b-4156-a8da-77003465f81d service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-10233665-4970-4a57-9e36-45e9a75829e3 req-9d74a328-253b-4156-a8da-77003465f81d service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-10233665-4970-4a57-9e36-45e9a75829e3 req-9d74a328-253b-4156-a8da-77003465f81d service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] No waiting events found dispatching network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:11 user nova-compute[74880]: WARNING nova.compute.manager [req-10233665-4970-4a57-9e36-45e9a75829e3 req-9d74a328-253b-4156-a8da-77003465f81d service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received unexpected event network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 for instance with vm_state building and task_state spawning.
Nov 15 01:25:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:25:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Instance spawned successfully.
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-ff9c71ee-a9cd-41dc-9d1b-41f0f514e544 req-51253d5e-3d32-4902-b0e1-9a9adb3cce56 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ff9c71ee-a9cd-41dc-9d1b-41f0f514e544 req-51253d5e-3d32-4902-b0e1-9a9adb3cce56 service nova] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ff9c71ee-a9cd-41dc-9d1b-41f0f514e544 req-51253d5e-3d32-4902-b0e1-9a9adb3cce56 service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ff9c71ee-a9cd-41dc-9d1b-41f0f514e544 req-51253d5e-3d32-4902-b0e1-9a9adb3cce56 service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-ff9c71ee-a9cd-41dc-9d1b-41f0f514e544 req-51253d5e-3d32-4902-b0e1-9a9adb3cce56 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] No waiting events found dispatching network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:13 user nova-compute[74880]: WARNING nova.compute.manager [req-ff9c71ee-a9cd-41dc-9d1b-41f0f514e544 req-51253d5e-3d32-4902-b0e1-9a9adb3cce56 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received unexpected event network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 for instance with vm_state building and task_state spawning.
Nov 15 01:25:14 user nova-compute[74880]: INFO nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:25:14 user nova-compute[74880]: INFO nova.compute.manager [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Took 6.45 seconds to build instance.
Nov 15 01:25:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a81495f3-24e8-42d0-927d-d8d81e924667 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.551s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:25:14 user nova-compute[74880]: INFO nova.compute.claims [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Claim successful on node user
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:25:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:25:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:25:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG nova.policy [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0b04e9fd63942fb9279c26ddeec3acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3350f1780d5464dae7c3eca61375446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:25:15 user nova-compute[74880]: INFO nova.virt.block_device [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Booting with volume 7397a78f-439d-4d7e-8175-2518aef395ef at /dev/vda
Nov 15 01:25:15 user nova-compute[74880]: DEBUG os_brick.utils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f79c3-cf80-4519-b385-0951bf8550a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2719669c-26d9-4817-bf5e-29da42412177]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f41e8-3601-4f20-8ee8-a32bd1a83145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d06db0-b016-4920-b0cc-f730138a7095]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:25:15 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:25:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f95ae5e-8ce0-447e-bec4-975dad23fdd9]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG os_brick.utils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:15 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating existing volume attachment record: 8d1b894b-9310-457e-b92a-48e4c7f3cb7c {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Successfully created port: 64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-changed-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Refreshing instance network info cache due to event network-changed-867c6194-568e-45ef-8222-558e115db573. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] Acquiring lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] Acquired lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.network.neutron [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Refreshing network info cache for port 867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Successfully updated port: 64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-changed-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.compute.manager [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Refreshing instance network info cache due to event network-changed-64bd0957-7c1f-4660-b3ff-2445d6af85d6. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:25:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance network_info: |[{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.network.neutron [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Refreshing network info cache for port 64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.network.neutron [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updated VIF entry in instance network info cache for port 867c6194-568e-45ef-8222-558e115db573. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.network.neutron [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f36261eb-554e-4f03-b131-3a0e08ad316d req-d04626d3-6d21-4402-bce7-133605cfe567 service nova] Releasing lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.network.neutron [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updated VIF entry in instance network info cache for port 64bd0957-7c1f-4660-b3ff-2445d6af85d6. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG nova.network.neutron [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-888e6698-0780-42c6-b40c-74d1f0002747 req-96a68699-d62b-4c09-93f0-b708eee07461 service nova] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:18 user nova-compute[74880]: INFO nova.compute.manager [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Attaching volume babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd to /dev/vdb
Nov 15 01:25:18 user nova-compute[74880]: DEBUG os_brick.utils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61b9788-153a-45dd-a0de-288f497a56f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4789d7-5349-45a9-b337-29b8bb00afad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec6e2a-83fa-4c37-b71d-9e595c520c39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5352c41-61a5-473c-ae8c-1907c047eb6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:25:18 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:25:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b79fccd-0c7e-44cf-8549-baf16efb4ca9]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG os_brick.utils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:18 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating existing volume attachment record: a0638112-8564-4e58-bfb7-28db637f940e {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:25:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Creating image(s)
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Ensure instance console log exists: /opt/stack/data/nova/instances/b73970f1-764f-46ed-a25a-b5418a91b17b/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Start _get_guest_xml network_info=[{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b73970f1-764f-46ed-a25a-b5418a91b17b', 'attached_at': '', 'detached_at': '', 'volume_id': '7397a78f-439d-4d7e-8175-2518aef395ef', 'serial': '7397a78f-439d-4d7e-8175-2518aef395ef'}, 'mount_device': '/dev/vda', 'attachment_id': '8d1b894b-9310-457e-b92a-48e4c7f3cb7c', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:25:20 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:25:20 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:20 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:20 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:20 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a295a3-9a3b-473c-9a3d-4fd5e06379b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:25:20 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bebe27-397b-42ba-9190-718957201601]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef] added
Nov 15 01:25:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb2279f-5a03-447b-b8dd-645c198cf65a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e5c1e7-68f6-4015-880a-dfd943c1122c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFQZlLof {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFQZlLof" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[08799244-69b7-415e-8af3-649100a8cd38]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFQZlLof'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e2d073-096e-4101-a313-caabc4b6807c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0be67d2-5493-4977-ba90-9571577040ee]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b67324-5be4-433c-a147-87b1ff9b1ae3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]
Nov 15 01:25:20 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.
Nov 15 01:25:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f1bf89-1033-4093-a699-5ceba80be96d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71704b87-cd80-47d2-ac6c-8ba139d68344]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:20 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:20 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46326af-5df0-4eca-b2c0-47729bb30355]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:25:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26136383733313834', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136383733313834', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-748895696',display_name='tempest-ServerActionsTestOtherA-server-748895696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-748895696',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-e3ryz9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=b73970f1-764f-46ed-a25a-b5418a91b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'pci_devices' on Instance uuid b73970f1-764f-46ed-a25a-b5418a91b17b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:25:21 user nova-compute[74880]:   <uuid>b73970f1-764f-46ed-a25a-b5418a91b17b</uuid>
Nov 15 01:25:21 user nova-compute[74880]:   <name>instance-0000001e</name>
Nov 15 01:25:21 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:25:21 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:25:21 user nova-compute[74880]:   <metadata>
Nov 15 01:25:21 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:25:21 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:25:21 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherA-server-748895696</nova:name>
Nov 15 01:25:21 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:25:20</nova:creationTime>
Nov 15 01:25:21 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:25:21 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:25:21 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:25:21 user nova-compute[74880]:       <nova:owner>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:user uuid="c0b04e9fd63942fb9279c26ddeec3acc">tempest-ServerActionsTestOtherA-1659960630-project-member</nova:user>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:project uuid="d3350f1780d5464dae7c3eca61375446">tempest-ServerActionsTestOtherA-1659960630</nova:project>
Nov 15 01:25:21 user nova-compute[74880]:       </nova:owner>
Nov 15 01:25:21 user nova-compute[74880]:       <nova:ports>
Nov 15 01:25:21 user nova-compute[74880]:         <nova:port uuid="64bd0957-7c1f-4660-b3ff-2445d6af85d6">
Nov 15 01:25:21 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:25:21 user nova-compute[74880]:         </nova:port>
Nov 15 01:25:21 user nova-compute[74880]:       </nova:ports>
Nov 15 01:25:21 user nova-compute[74880]:     </nova:instance>
Nov 15 01:25:21 user nova-compute[74880]:   </metadata>
Nov 15 01:25:21 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:25:21 user nova-compute[74880]:     <system>
Nov 15 01:25:21 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:25:21 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:25:21 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:25:21 user nova-compute[74880]:       <entry name="serial">b73970f1-764f-46ed-a25a-b5418a91b17b</entry>
Nov 15 01:25:21 user nova-compute[74880]:       <entry name="uuid">b73970f1-764f-46ed-a25a-b5418a91b17b</entry>
Nov 15 01:25:21 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:25:21 user nova-compute[74880]:     </system>
Nov 15 01:25:21 user nova-compute[74880]:   </sysinfo>
Nov 15 01:25:21 user nova-compute[74880]:   <os>
Nov 15 01:25:21 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:25:21 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:25:21 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:25:21 user nova-compute[74880]:   </os>
Nov 15 01:25:21 user nova-compute[74880]:   <features>
Nov 15 01:25:21 user nova-compute[74880]:     <acpi/>
Nov 15 01:25:21 user nova-compute[74880]:     <apic/>
Nov 15 01:25:21 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:25:21 user nova-compute[74880]:   </features>
Nov 15 01:25:21 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:25:21 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:25:21 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:25:21 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:25:21 user nova-compute[74880]:   </clock>
Nov 15 01:25:21 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:25:21 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:25:21 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:25:21 user nova-compute[74880]:   </cpu>
Nov 15 01:25:21 user nova-compute[74880]:   <devices>
Nov 15 01:25:21 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:25:21 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:25:21 user nova-compute[74880]:       <source dev="/dev/sdf"/>
Nov 15 01:25:21 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:25:21 user nova-compute[74880]:       <serial>7397a78f-439d-4d7e-8175-2518aef395ef</serial>
Nov 15 01:25:21 user nova-compute[74880]:     </disk>
Nov 15 01:25:21 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:25:21 user nova-compute[74880]:       <mac address="fa:16:3e:c8:3d:0a"/>
Nov 15 01:25:21 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:25:21 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:25:21 user nova-compute[74880]:       <target dev="tap64bd0957-7c"/>
Nov 15 01:25:21 user nova-compute[74880]:     </interface>
Nov 15 01:25:21 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:25:21 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/b73970f1-764f-46ed-a25a-b5418a91b17b/console.log" append="off"/>
Nov 15 01:25:21 user nova-compute[74880]:     </serial>
Nov 15 01:25:21 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:25:21 user nova-compute[74880]:     <video>
Nov 15 01:25:21 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:25:21 user nova-compute[74880]:     </video>
Nov 15 01:25:21 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:25:21 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:25:21 user nova-compute[74880]:     </rng>
Nov 15 01:25:21 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:25:21 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:25:21 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:25:21 user nova-compute[74880]:     </memballoon>
Nov 15 01:25:21 user nova-compute[74880]:   </devices>
Nov 15 01:25:21 user nova-compute[74880]: </domain>
Nov 15 01:25:21 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-748895696',display_name='tempest-ServerActionsTestOtherA-server-748895696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-748895696',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-e3ryz9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=b73970f1-764f-46ed-a25a-b5418a91b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG os_vif [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5792657b-2d3a-5512-8a4c-72f4841986dd', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64bd0957-7c, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64bd0957-7c, col_values=(('qos', UUID('a4424caa-eed7-45a8-9f21-d8402a5a652c')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64bd0957-7c, col_values=(('external_ids', {'iface-id': '64bd0957-7c1f-4660-b3ff-2445d6af85d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:3d:0a', 'vm-uuid': 'b73970f1-764f-46ed-a25a-b5418a91b17b'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:21 user nova-compute[74880]: INFO os_vif [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c')
Nov 15 01:25:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:25:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No VIF found with MAC fa:16:3e:c8:3d:0a, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-e028abe1-9d96-4a98-b38e-c9d9e931af80 req-40fa7c34-6888-4ee6-8d3f-fee572f5f3b2 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e028abe1-9d96-4a98-b38e-c9d9e931af80 req-40fa7c34-6888-4ee6-8d3f-fee572f5f3b2 service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e028abe1-9d96-4a98-b38e-c9d9e931af80 req-40fa7c34-6888-4ee6-8d3f-fee572f5f3b2 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e028abe1-9d96-4a98-b38e-c9d9e931af80 req-40fa7c34-6888-4ee6-8d3f-fee572f5f3b2 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-e028abe1-9d96-4a98-b38e-c9d9e931af80 req-40fa7c34-6888-4ee6-8d3f-fee572f5f3b2 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:23 user nova-compute[74880]: WARNING nova.compute.manager [req-e028abe1-9d96-4a98-b38e-c9d9e931af80 req-40fa7c34-6888-4ee6-8d3f-fee572f5f3b2 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state building and task_state spawning.
Nov 15 01:25:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:23 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:23 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:23 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d95ecd-9efc-402d-af01-93466624875f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:25:23 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28191f53-853f-4790-bff9-0cbbfafc1086]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd] added
Nov 15 01:25:23 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e372c5-f692-4d20-8919-d76dcd1dbc7f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37066864-0de9-4224-918c-d6873467b10a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYOSKZcL {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYOSKZcL" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[56622820-57ad-450a-b157-4ad829f3eaf6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYOSKZcL'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0682c416-8b72-4eff-a8d2-c7e438a088b4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf66d3ed-5357-4758-aa0f-f1fa6632ca6a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:23 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:23 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83cfef-a63d-497d-9cc5-549887449c0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]
Nov 15 01:25:23 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.
Nov 15 01:25:23 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aafb58-c3cc-4e95-b495-8dbe20b7788a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba84913c-d02c-46f0-b986-4ff2cdc7fd4a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:23 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:23 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:23 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ff317-2d56-440a-b832-acc349211f13]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:25:23 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:25:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23061303233633862', 'path': '/dev/sdg'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061303233633862', 'path': '/dev/sdg'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:25:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:25:25 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:25:25 user nova-compute[74880]:   <source dev="/dev/sdg"/>
Nov 15 01:25:25 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:25:25 user nova-compute[74880]:   <serial>babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd</serial>
Nov 15 01:25:25 user nova-compute[74880]: </disk>
Nov 15 01:25:25 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No VIF found with MAC fa:16:3e:45:24:9c, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:25:25 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance spawned successfully.
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-98308ae6-75d7-4c9f-854b-0fdcc7996b10 req-de337bbb-fcf4-44dd-95f8-d86517cf72d7 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-98308ae6-75d7-4c9f-854b-0fdcc7996b10 req-de337bbb-fcf4-44dd-95f8-d86517cf72d7 service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-98308ae6-75d7-4c9f-854b-0fdcc7996b10 req-de337bbb-fcf4-44dd-95f8-d86517cf72d7 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-98308ae6-75d7-4c9f-854b-0fdcc7996b10 req-de337bbb-fcf4-44dd-95f8-d86517cf72d7 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-98308ae6-75d7-4c9f-854b-0fdcc7996b10 req-de337bbb-fcf4-44dd-95f8-d86517cf72d7 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:25 user nova-compute[74880]: WARNING nova.compute.manager [req-98308ae6-75d7-4c9f-854b-0fdcc7996b10 req-de337bbb-fcf4-44dd-95f8-d86517cf72d7 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state building and task_state spawning.
Nov 15 01:25:25 user nova-compute[74880]: INFO nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 01:25:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:25:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-03a230b3-a9d0-4443-94cb-5f16046c854a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.077s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:25 user nova-compute[74880]: INFO nova.compute.manager [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Took 11.43 seconds to build instance.
Nov 15 01:25:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f28cbb4a-a74f-4a1f-924c-c1ecea611aae tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.529s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74880) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG nova.objects.instance [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-712c4b56-d02c-4448-a469-43435c9faecf req-d3e5f2a7-f6c8-4748-b21c-697aa3ac00cc service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-712c4b56-d02c-4448-a469-43435c9faecf req-d3e5f2a7-f6c8-4748-b21c-697aa3ac00cc service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-712c4b56-d02c-4448-a469-43435c9faecf req-d3e5f2a7-f6c8-4748-b21c-697aa3ac00cc service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-712c4b56-d02c-4448-a469-43435c9faecf req-d3e5f2a7-f6c8-4748-b21c-697aa3ac00cc service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-712c4b56-d02c-4448-a469-43435c9faecf req-d3e5f2a7-f6c8-4748-b21c-697aa3ac00cc service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:26 user nova-compute[74880]: WARNING nova.compute.manager [req-712c4b56-d02c-4448-a469-43435c9faecf req-d3e5f2a7-f6c8-4748-b21c-697aa3ac00cc service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state active and task_state powering-off.
Nov 15 01:25:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:27 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance destroyed successfully.
Nov 15 01:25:27 user nova-compute[74880]: DEBUG nova.compute.manager [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-05f3ef9b-e2f0-4d0b-81ce-c2359c07e78a tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.908s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 is timed out.
Nov 15 01:25:27 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully detached device vdb from instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 from the live domain config.
Nov 15 01:25:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBoXGFur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:27 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22e2631-b977-4aeb-8fdd-1f576b017565]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:25:27 user nova-compute[74880]: No targets found.
Nov 15 01:25:27 user nova-compute[74880]: iSNS:
Nov 15 01:25:27 user nova-compute[74880]: No targets found.
Nov 15 01:25:27 user nova-compute[74880]: STATIC:
Nov 15 01:25:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb
Nov 15 01:25:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:25:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:25:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:25:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:25:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:25:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:27 user nova-compute[74880]: FIRMWARE:
Nov 15 01:25:27 user nova-compute[74880]: No targets found.
Nov 15 01:25:27 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:25:27 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:25:27 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efaa64-212f-48dd-b517-6123d81d7aab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab7f8c7-f9ad-4c78-9a0e-114c90f1892d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:27 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:27 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:27 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01da290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7d1412-f9f4-488f-884c-82c8c4325ac8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8519076e-5d39-43e0-bdfe-aa7c65bf6e83]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5336f89-ad6a-4632-b1ce-f2af47832d7e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1ef3dc-c938-4f9a-a2ec-6df1911dbd6f]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f5495-b0e2-49bb-b357-076bcf57b12f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0dd95c-f7cd-4850-b040-aeec1fd748b7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260]
Nov 15 01:25:28 user nova-compute[74880]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb, portal: 172.16.0.220,3260] successful.
Nov 15 01:25:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2dec1f-136f-4e86-ba14-da3a15069a98]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== disconnect_volume: return (362ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG nova.objects.instance [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'flavor' on Instance uuid 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-1f99de69-85db-43d2-a8ef-4fa081195a9e tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.648s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:28 user nova-compute[74880]: INFO nova.compute.manager [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Terminating instance
Nov 15 01:25:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-94b41e9f-7246-4d9b-8867-6244a6ab218f req-77d5e279-c9d4-4246-ab60-8807daf98f0b service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-94b41e9f-7246-4d9b-8867-6244a6ab218f req-77d5e279-c9d4-4246-ab60-8807daf98f0b service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-94b41e9f-7246-4d9b-8867-6244a6ab218f req-77d5e279-c9d4-4246-ab60-8807daf98f0b service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-94b41e9f-7246-4d9b-8867-6244a6ab218f req-77d5e279-c9d4-4246-ab60-8807daf98f0b service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-94b41e9f-7246-4d9b-8867-6244a6ab218f req-77d5e279-c9d4-4246-ab60-8807daf98f0b service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:28 user nova-compute[74880]: WARNING nova.compute.manager [req-94b41e9f-7246-4d9b-8867-6244a6ab218f req-77d5e279-c9d4-4246-ab60-8807daf98f0b service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state stopped and task_state None.
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-f0b294a8-c155-42df-8d58-32f01fef85c1 req-a499c089-517e-4bbd-b55a-12127512243f service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-vif-unplugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f0b294a8-c155-42df-8d58-32f01fef85c1 req-a499c089-517e-4bbd-b55a-12127512243f service nova] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f0b294a8-c155-42df-8d58-32f01fef85c1 req-a499c089-517e-4bbd-b55a-12127512243f service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f0b294a8-c155-42df-8d58-32f01fef85c1 req-a499c089-517e-4bbd-b55a-12127512243f service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-f0b294a8-c155-42df-8d58-32f01fef85c1 req-a499c089-517e-4bbd-b55a-12127512243f service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] No waiting events found dispatching network-vif-unplugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-f0b294a8-c155-42df-8d58-32f01fef85c1 req-a499c089-517e-4bbd-b55a-12127512243f service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-vif-unplugged-8d49b499-57bd-4d6e-a446-5cf63617047d for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:25:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Instance destroyed successfully.
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lazy-loading 'resources' on Instance uuid 3a37e5f8-0c79-4a15-bef1-43a12b7b8770 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-797180028',display_name='tempest-VolumesSnapshotTestJSON-instance-797180028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-797180028',id=25,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDEvXxmEWpIK9aFTrRG2prxiJaujDbb8xlBv+hIJLgDJdNawjN20M/kn3MxdHrFRsj7FR2pXVlcrqeBy0cnifF4xdYXIWfnqFtMpEFxuUZ8UHtTjymTrzYA8htcOYi4Cw==',key_name='tempest-keypair-247033617',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fb3f3931294909bfc88b6569034b6d',ramdisk_id='',reservation_id='r-m2agh3in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-648990630',owner_user_name='tempest-VolumesSnapshotTestJSON-648990630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2750a138414933b47db189a233aaed',uuid=3a37e5f8-0c79-4a15-bef1-43a12b7b8770,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converting VIF {"id": "8d49b499-57bd-4d6e-a446-5cf63617047d", "address": "fa:16:3e:83:c3:e0", "network": {"id": "f5707cca-7dab-4b41-b83a-d874a217d102", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-168534138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fb3f3931294909bfc88b6569034b6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d49b499-57", "ovs_interfaceid": "8d49b499-57bd-4d6e-a446-5cf63617047d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_vif [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d49b499-57, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63416fee-4565-4c9a-9162-dbcc5f9704c1) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:29 user nova-compute[74880]: INFO os_vif [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c3:e0,bridge_name='br-int',has_traffic_filtering=True,id=8d49b499-57bd-4d6e-a446-5cf63617047d,network=Network(f5707cca-7dab-4b41-b83a-d874a217d102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d49b499-57')
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBoXGFur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:29 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ba2854-5862-4737-9284-ff273becc7eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:25:29 user nova-compute[74880]: No targets found.
Nov 15 01:25:29 user nova-compute[74880]: iSNS:
Nov 15 01:25:29 user nova-compute[74880]: No targets found.
Nov 15 01:25:29 user nova-compute[74880]: STATIC:
Nov 15 01:25:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:25:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:25:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:25:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:25:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:25:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:29 user nova-compute[74880]: FIRMWARE:
Nov 15 01:25:29 user nova-compute[74880]: No targets found.
Nov 15 01:25:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:25:29 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:25:29 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7257651-3045-4ea2-ac20-f6c85904d6eb', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdcfc34-2764-47dc-8ad3-9da502f5d30d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[542e7954-836d-4508-a26a-584ff3b366c4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:29 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01da710>, {}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Disconnecting from: [] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] <== disconnect_volume: return (88ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:25:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Deleting instance files /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770_del
Nov 15 01:25:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Deletion of /opt/stack/data/nova/instances/3a37e5f8-0c79-4a15-bef1-43a12b7b8770_del complete
Nov 15 01:25:29 user nova-compute[74880]: INFO nova.compute.manager [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 01:25:29 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:25:29 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:31 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Took 1.15 seconds to deallocate network for instance.
Nov 15 01:25:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-52c2ed20-6a85-42d5-a208-f7edb44eaeb3 req-c676fb57-381a-4692-8c5b-c29f9b9318c1 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-vif-deleted-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:31 user nova-compute[74880]: WARNING nova.volume.cinder [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Attachment c5ff2d70-3375-43a2-a60e-338ad8acb7cc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c5ff2d70-3375-43a2-a60e-338ad8acb7cc. (HTTP 404) (Request-ID: req-8920097a-a328-4ae2-b8f7-ad0fd395c727)
Nov 15 01:25:31 user nova-compute[74880]: INFO nova.compute.manager [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-8c95d35c-a0e7-4566-8d71-6f2e88c84b2c req-2811a6a4-bb26-4382-9a3e-6d2ab9f28285 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received event network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8c95d35c-a0e7-4566-8d71-6f2e88c84b2c req-2811a6a4-bb26-4382-9a3e-6d2ab9f28285 service nova] Acquiring lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8c95d35c-a0e7-4566-8d71-6f2e88c84b2c req-2811a6a4-bb26-4382-9a3e-6d2ab9f28285 service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8c95d35c-a0e7-4566-8d71-6f2e88c84b2c req-2811a6a4-bb26-4382-9a3e-6d2ab9f28285 service nova] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-8c95d35c-a0e7-4566-8d71-6f2e88c84b2c req-2811a6a4-bb26-4382-9a3e-6d2ab9f28285 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] No waiting events found dispatching network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:31 user nova-compute[74880]: WARNING nova.compute.manager [req-8c95d35c-a0e7-4566-8d71-6f2e88c84b2c req-2811a6a4-bb26-4382-9a3e-6d2ab9f28285 service nova] [instance: 3a37e5f8-0c79-4a15-bef1-43a12b7b8770] Received unexpected event network-vif-plugged-8d49b499-57bd-4d6e-a446-5cf63617047d for instance with vm_state deleted and task_state None.
Nov 15 01:25:31 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:31 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Deleted allocations for instance 3a37e5f8-0c79-4a15-bef1-43a12b7b8770
Nov 15 01:25:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0d2748b8-4f7c-4ae4-a688-b5df3c09398b tempest-VolumesSnapshotTestJSON-648990630 tempest-VolumesSnapshotTestJSON-648990630-project-member] Lock "3a37e5f8-0c79-4a15-bef1-43a12b7b8770" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing instance network info cache due to event network-changed-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:25:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] Acquiring lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] Acquired lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Refreshing network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:38 user nova-compute[74880]: INFO nova.compute.manager [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Terminating instance
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-bc0057fb-308e-4be3-9a8c-453cf596b8cb req-9c9124c8-4321-43da-9ba1-c9233c266f0c service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-unplugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bc0057fb-308e-4be3-9a8c-453cf596b8cb req-9c9124c8-4321-43da-9ba1-c9233c266f0c service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bc0057fb-308e-4be3-9a8c-453cf596b8cb req-9c9124c8-4321-43da-9ba1-c9233c266f0c service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bc0057fb-308e-4be3-9a8c-453cf596b8cb req-9c9124c8-4321-43da-9ba1-c9233c266f0c service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-bc0057fb-308e-4be3-9a8c-453cf596b8cb req-9c9124c8-4321-43da-9ba1-c9233c266f0c service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-unplugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-bc0057fb-308e-4be3-9a8c-453cf596b8cb req-9c9124c8-4321-43da-9ba1-c9233c266f0c service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-unplugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Instance destroyed successfully.
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.objects.instance [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lazy-loading 'resources' on Instance uuid 13e06f94-a4f0-4902-ab35-61e4fd7bfc42 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-302427772',display_name='tempest-TestShelveInstance-server-302427772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-302427772',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4RRtmqzNYdB6YRArPnATXrgiNoIqLqoruxJJksrsPCwOkLwDLsD5KYHtl9McK9638HYcADKHm6/2lP52nv83so876aZTWJYlRATyrXBsHiPXmV6phECNET/p3TqAgbUg==',key_name='tempest-TestShelveInstance-307644609',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b0a12699b5248acaeb4a4f4e749647d',ramdisk_id='',reservation_id='r-kdr1j5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1190185298',owner_user_name='tempest-TestShelveInstance-1190185298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:23:59Z,user_data=None,user_id='f9842f5af61240cfbb507e82bffbc15f',uuid=13e06f94-a4f0-4902-ab35-61e4fd7bfc42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converting VIF {"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_vif [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dc4646f-3a, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a1138b0-3106-4ebf-98e8-ba6b697fe95e) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:38 user nova-compute[74880]: INFO os_vif [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:81:3f,bridge_name='br-int',has_traffic_filtering=True,id=5dc4646f-3ae7-4e83-beae-a2da33ad6ce1,network=Network(93f0b375-9c13-40ee-a6e2-f212c8d3e610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc4646f-3a')
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGVTloYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:25:38 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updated VIF entry in instance network info cache for port 5dc4646f-3ae7-4e83-beae-a2da33ad6ce1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [{"id": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "address": "fa:16:3e:82:81:3f", "network": {"id": "93f0b375-9c13-40ee-a6e2-f212c8d3e610", "bridge": "br-int", "label": "tempest-TestShelveInstance-1944365595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b0a12699b5248acaeb4a4f4e749647d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc4646f-3a", "ovs_interfaceid": "5dc4646f-3ae7-4e83-beae-a2da33ad6ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[215a0738-db57-485d-b6bc-3920026d7302]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:25:38 user nova-compute[74880]: No targets found.
Nov 15 01:25:38 user nova-compute[74880]: iSNS:
Nov 15 01:25:38 user nova-compute[74880]: No targets found.
Nov 15 01:25:38 user nova-compute[74880]: STATIC:
Nov 15 01:25:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:25:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:25:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:25:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5
Nov 15 01:25:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:25:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:25:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:25:38 user nova-compute[74880]: FIRMWARE:
Nov 15 01:25:38 user nova-compute[74880]: No targets found.
Nov 15 01:25:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:25:38 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:25:38 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-46927ec0-af3e-4c03-afbd-0ad31456ecb6 req-66c95d8c-4524-4474-9f6c-ab91599ca2bd service nova] Releasing lock "refresh_cache-13e06f94-a4f0-4902-ab35-61e4fd7bfc42" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b27b3-dbcf-4d80-8a4a-3835dd216e6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e485f798-931a-48ce-8367-f35d81634878]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:25:38 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:25:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01c3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:25:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3794a53a-f2f9-499e-8439-4f700d1b9d72]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485b48e-efeb-4848-b859-d3292b7ac8c5]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3dd0d9-2412-4020-b1ca-da450b830518]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff76483-2eef-4d4b-ba8b-3acfe9d2af6e]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_eb93bb24', '/dev/disk/by-id/scsi-1SCST_BIOeb93bb24-08a7bae0e2cd9e4f', '/dev/disk/by-id/scsi-23038613762616530') {{(pid=85948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b80847-e59f-45c5-b597-0cab47ce46d4]: (4, None) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[986226b3-2c50-4859-bc4d-cebd746589ea]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d56bf-cb25-413a-a219-b19612c73853]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260]
Nov 15 01:25:39 user nova-compute[74880]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5, portal: 172.16.0.220,3260] successful.
Nov 15 01:25:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a84c65-dc09-45db-89fd-d1e2403ae4b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d4b55-f71d-4f47-96b2-d7a453ddc649]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] <== disconnect_volume: return (404ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:25:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Deleting instance files /opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42_del
Nov 15 01:25:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Deletion of /opt/stack/data/nova/instances/13e06f94-a4f0-4902-ab35-61e4fd7bfc42_del complete
Nov 15 01:25:39 user nova-compute[74880]: INFO nova.compute.manager [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 15 01:25:39 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:25:39 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:39 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Took 0.49 seconds to deallocate network for instance.
Nov 15 01:25:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] Acquiring lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] No waiting events found dispatching network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:25:40 user nova-compute[74880]: WARNING nova.compute.manager [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received unexpected event network-vif-plugged-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 for instance with vm_state active and task_state deleting.
Nov 15 01:25:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-609e8da4-9da9-49f5-bfe7-44f3b8d5a689 req-be2b2012-7e0c-4004-8eef-b1ab633dca09 service nova] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Received event network-vif-deleted-5dc4646f-3ae7-4e83-beae-a2da33ad6ce1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:25:40 user nova-compute[74880]: INFO nova.compute.manager [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Took 1.07 seconds to detach 1 volumes for instance.
Nov 15 01:25:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] [instance: 13e06f94-a4f0-4902-ab35-61e4fd7bfc42] Deleting volume: 36a84c65-dc09-45db-89fd-d1e2403ae4b5 {{(pid=74880) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 01:25:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:41 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:25:41 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:25:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:41 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Deleted allocations for instance 13e06f94-a4f0-4902-ab35-61e4fd7bfc42
Nov 15 01:25:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-db901bbb-3848-40ee-897d-bbed375855ed tempest-TestShelveInstance-1190185298 tempest-TestShelveInstance-1190185298-project-member] Lock "13e06f94-a4f0-4902-ab35-61e4fd7bfc42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.487s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:25:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:25:51 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:25:51 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7321MB free_disk=25.276798248291016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 88540810-db28-4f01-aa45-5cc4497214e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 97877ac2-ab65-413a-96a1-928847c8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance b73970f1-764f-46ed-a25a-b5418a91b17b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:25:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:25:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:25:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:25:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:25:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [{"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:25:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:25:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:00 user nova-compute[74880]: INFO nova.compute.manager [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Unrescuing
Nov 15 01:26:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:00 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'flavor' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f40bcc0-9bde-4f94-87f6-72ec6ae79476 req-0d2826b8-f3fa-4275-8edb-9966ab8a14b2 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f40bcc0-9bde-4f94-87f6-72ec6ae79476 req-0d2826b8-f3fa-4275-8edb-9966ab8a14b2 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f40bcc0-9bde-4f94-87f6-72ec6ae79476 req-0d2826b8-f3fa-4275-8edb-9966ab8a14b2 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9f40bcc0-9bde-4f94-87f6-72ec6ae79476 req-0d2826b8-f3fa-4275-8edb-9966ab8a14b2 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f40bcc0-9bde-4f94-87f6-72ec6ae79476 req-0d2826b8-f3fa-4275-8edb-9966ab8a14b2 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:01 user nova-compute[74880]: WARNING nova.compute.manager [req-9f40bcc0-9bde-4f94-87f6-72ec6ae79476 req-0d2826b8-f3fa-4275-8edb-9966ab8a14b2 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:26:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance destroyed successfully.
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:03 user nova-compute[74880]: WARNING nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:26:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:03 user nova-compute[74880]: WARNING nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:26:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:03 user nova-compute[74880]: WARNING nova.compute.manager [req-8b08e128-b944-4011-997f-06cf05c0648f req-48995dd4-3036-42c8-b553-e191aeb33787 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:26:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcd9ccda-71eb-4d29-8f84-016226892645 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:26:05 user nova-compute[74880]: INFO nova.compute.claims [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Claim successful on node user
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:26:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:26:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:26:06 user nova-compute[74880]: INFO nova.virt.block_device [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Booting with blank volume at /dev/vda
Nov 15 01:26:06 user nova-compute[74880]: DEBUG nova.policy [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd34159a5cea6426f8e4303dbf20a99af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cac8f31694b1abcac7d3cfaac76ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:26:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Successfully created port: dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:26:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Successfully updated port: dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:26:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-changed-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Refreshing instance network info cache due to event network-changed-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] Acquiring lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance network_info: |[{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] Acquired lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG nova.network.neutron [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Refreshing network info cache for port dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:26:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updated VIF entry in instance network info cache for port dccf1c4f-87ec-42b8-97d5-21d7dd01c98e. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:26:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0d5111d4-afc0-490e-8572-6e47c0fa45b7 req-431cc908-8afa-4b34-bb0b-2a370870e79d service nova] Releasing lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG os_brick.utils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece2dda-0eba-4d58-ab78-ddc03479b532]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea15dd-d023-459a-a25c-478e79637326]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b2725-98ca-4f12-99d4-feacef1f2be8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f948a-23fe-4f0a-a284-53b6d30c989a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:26:12 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:26:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2abde10-45e8-47c4-bc94-2705dbd3c867]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG os_brick.utils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:12 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating existing volume attachment record: 985dabb4-9b4f-4175-9e83-3d8db5e75ed9 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:26:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:26:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Creating image(s)
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Ensure instance console log exists: /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Start _get_guest_xml network_info=[{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8bc89cdc-b0df-44cb-87fe-daefba1fea88', 'attached_at': '', 'detached_at': '', 'volume_id': '8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'serial': '8aa16c6f-b074-4334-bc6c-277eae1ba23e'}, 'mount_device': '/dev/vda', 'attachment_id': '985dabb4-9b4f-4175-9e83-3d8db5e75ed9', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:26:17 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:26:17 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:17 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:26:17 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:26:17 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11034b3a-4194-4fa4-be71-e7ddb1a43d6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:26:17 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4baf05f-75ba-4f1e-9d13-dcded2d8e177]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e] added
Nov 15 01:26:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e5dbe2-7457-42fd-84d4-0af655118dc2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0715eb80-b5a5-4c24-a57d-739b9939057b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYFdENzS {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYFdENzS" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc363667-4a42-42fc-b7a9-3918f5fc9d65]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BYFdENzS'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0d57f7-05f7-4336-b23d-e8530145a315]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6f27bd-1afe-4063-b4c2-b9c4afa892af]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740e763-7d9b-4ad8-b5d6-595313e28170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260]
Nov 15 01:26:17 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260] successful.
Nov 15 01:26:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3abce-9267-4d75-8fa7-7ed1e1078773]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bea52a-d7c4-4168-b216-9b2639870d20]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:17 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa3acdc-d097-49e0-b9e3-5b72c28a6646]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:17 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23537323239366664', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537323239366664', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2136740006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2136740006',id=31,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-rs6swch3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:07Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=8bc89cdc-b0df-44cb-87fe-daefba1fea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:26:18 user nova-compute[74880]:   <uuid>8bc89cdc-b0df-44cb-87fe-daefba1fea88</uuid>
Nov 15 01:26:18 user nova-compute[74880]:   <name>instance-0000001f</name>
Nov 15 01:26:18 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:26:18 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:26:18 user nova-compute[74880]:   <metadata>
Nov 15 01:26:18 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:26:18 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:26:18 user nova-compute[74880]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2136740006</nova:name>
Nov 15 01:26:18 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:26:17</nova:creationTime>
Nov 15 01:26:18 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:26:18 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:26:18 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:26:18 user nova-compute[74880]:       <nova:owner>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:user uuid="d34159a5cea6426f8e4303dbf20a99af">tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member</nova:user>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:project uuid="069cac8f31694b1abcac7d3cfaac76ed">tempest-ServerBootFromVolumeStableRescueTest-330586401</nova:project>
Nov 15 01:26:18 user nova-compute[74880]:       </nova:owner>
Nov 15 01:26:18 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:26:18 user nova-compute[74880]:       <nova:ports>
Nov 15 01:26:18 user nova-compute[74880]:         <nova:port uuid="dccf1c4f-87ec-42b8-97d5-21d7dd01c98e">
Nov 15 01:26:18 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 01:26:18 user nova-compute[74880]:         </nova:port>
Nov 15 01:26:18 user nova-compute[74880]:       </nova:ports>
Nov 15 01:26:18 user nova-compute[74880]:     </nova:instance>
Nov 15 01:26:18 user nova-compute[74880]:   </metadata>
Nov 15 01:26:18 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:26:18 user nova-compute[74880]:     <system>
Nov 15 01:26:18 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:26:18 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:26:18 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:26:18 user nova-compute[74880]:       <entry name="serial">8bc89cdc-b0df-44cb-87fe-daefba1fea88</entry>
Nov 15 01:26:18 user nova-compute[74880]:       <entry name="uuid">8bc89cdc-b0df-44cb-87fe-daefba1fea88</entry>
Nov 15 01:26:18 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:26:18 user nova-compute[74880]:     </system>
Nov 15 01:26:18 user nova-compute[74880]:   </sysinfo>
Nov 15 01:26:18 user nova-compute[74880]:   <os>
Nov 15 01:26:18 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:26:18 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:26:18 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:26:18 user nova-compute[74880]:   </os>
Nov 15 01:26:18 user nova-compute[74880]:   <features>
Nov 15 01:26:18 user nova-compute[74880]:     <acpi/>
Nov 15 01:26:18 user nova-compute[74880]:     <apic/>
Nov 15 01:26:18 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:26:18 user nova-compute[74880]:   </features>
Nov 15 01:26:18 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:26:18 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:26:18 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:26:18 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:26:18 user nova-compute[74880]:   </clock>
Nov 15 01:26:18 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:26:18 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:26:18 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:26:18 user nova-compute[74880]:   </cpu>
Nov 15 01:26:18 user nova-compute[74880]:   <devices>
Nov 15 01:26:18 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:26:18 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:26:18 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:26:18 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:26:18 user nova-compute[74880]:       <serial>8aa16c6f-b074-4334-bc6c-277eae1ba23e</serial>
Nov 15 01:26:18 user nova-compute[74880]:     </disk>
Nov 15 01:26:18 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:26:18 user nova-compute[74880]:       <mac address="fa:16:3e:42:63:13"/>
Nov 15 01:26:18 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:26:18 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:26:18 user nova-compute[74880]:       <target dev="tapdccf1c4f-87"/>
Nov 15 01:26:18 user nova-compute[74880]:     </interface>
Nov 15 01:26:18 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:26:18 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/console.log" append="off"/>
Nov 15 01:26:18 user nova-compute[74880]:     </serial>
Nov 15 01:26:18 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:26:18 user nova-compute[74880]:     <video>
Nov 15 01:26:18 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:26:18 user nova-compute[74880]:     </video>
Nov 15 01:26:18 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:26:18 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:26:18 user nova-compute[74880]:     </rng>
Nov 15 01:26:18 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:26:18 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:26:18 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:26:18 user nova-compute[74880]:     </memballoon>
Nov 15 01:26:18 user nova-compute[74880]:   </devices>
Nov 15 01:26:18 user nova-compute[74880]: </domain>
Nov 15 01:26:18 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2136740006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2136740006',id=31,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-rs6swch3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:07Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=8bc89cdc-b0df-44cb-87fe-daefba1fea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG os_vif [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90e6c9d1-0bbb-5f74-9eca-35b027e45521', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdccf1c4f-87, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdccf1c4f-87, col_values=(('qos', UUID('36bfcd19-57cc-48ed-978e-6667248d10ff')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdccf1c4f-87, col_values=(('external_ids', {'iface-id': 'dccf1c4f-87ec-42b8-97d5-21d7dd01c98e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:63:13', 'vm-uuid': '8bc89cdc-b0df-44cb-87fe-daefba1fea88'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:18 user nova-compute[74880]: INFO os_vif [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87')
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:26:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No VIF found with MAC fa:16:3e:42:63:13, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-28bd3b8f-cf9a-42d6-be66-7533e47463ca req-f471f570-a709-4ce4-a125-2d04aa3f7b70 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-28bd3b8f-cf9a-42d6-be66-7533e47463ca req-f471f570-a709-4ce4-a125-2d04aa3f7b70 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-28bd3b8f-cf9a-42d6-be66-7533e47463ca req-f471f570-a709-4ce4-a125-2d04aa3f7b70 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-28bd3b8f-cf9a-42d6-be66-7533e47463ca req-f471f570-a709-4ce4-a125-2d04aa3f7b70 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-28bd3b8f-cf9a-42d6-be66-7533e47463ca req-f471f570-a709-4ce4-a125-2d04aa3f7b70 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:20 user nova-compute[74880]: WARNING nova.compute.manager [req-28bd3b8f-cf9a-42d6-be66-7533e47463ca req-f471f570-a709-4ce4-a125-2d04aa3f7b70 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state building and task_state spawning.
Nov 15 01:26:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:26:22 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance spawned successfully.
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:26:22 user nova-compute[74880]: INFO nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-77151d3d-546c-47c0-9456-f7f540a9ad2e req-285555a4-721c-446e-9235-1d6c708e1b89 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77151d3d-546c-47c0-9456-f7f540a9ad2e req-285555a4-721c-446e-9235-1d6c708e1b89 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77151d3d-546c-47c0-9456-f7f540a9ad2e req-285555a4-721c-446e-9235-1d6c708e1b89 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77151d3d-546c-47c0-9456-f7f540a9ad2e req-285555a4-721c-446e-9235-1d6c708e1b89 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-77151d3d-546c-47c0-9456-f7f540a9ad2e req-285555a4-721c-446e-9235-1d6c708e1b89 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:22 user nova-compute[74880]: WARNING nova.compute.manager [req-77151d3d-546c-47c0-9456-f7f540a9ad2e req-285555a4-721c-446e-9235-1d6c708e1b89 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state building and task_state spawning.
Nov 15 01:26:22 user nova-compute[74880]: INFO nova.compute.manager [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Took 16.98 seconds to build instance.
Nov 15 01:26:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-834ffedc-c890-48c2-83ff-f29e5b3467c1 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.084s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-changed-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Refreshing instance network info cache due to event network-changed-6c622032-85ad-4e3a-a024-a930e3231611. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] Acquiring lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] Acquired lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Refreshing network info cache for port 6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updated VIF entry in instance network info cache for port 6c622032-85ad-4e3a-a024-a930e3231611. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updating instance_info_cache with network_info: [{"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6971a900-3824-43dd-ab8b-c959bb18c611 req-89e61671-5269-4303-b748-0412ed804bd4 service nova] Releasing lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG nova.objects.instance [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'flavor' on Instance uuid 97877ac2-ab65-413a-96a1-928847c8a0a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:28 user nova-compute[74880]: INFO nova.compute.manager [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Attaching volume 217f57f2-c3a0-4bec-a62c-9e4024afd068 to /dev/vdb
Nov 15 01:26:29 user nova-compute[74880]: DEBUG os_brick.utils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a02a92e-c76d-4f26-a8fb-44f970fe7044]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[24408a65-edf6-4f71-ac18-a4bf2cd3144c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1c9f4d-8ff6-4a09-a650-7387397c555f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efd16e3-89fb-4e01-a2a0-18b40e77eb7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:26:29 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:26:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f17e298-2367-4db5-ae69-d15274b126cf]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG os_brick.utils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:29 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updating existing volume attachment record: 4a44f4f6-ab0f-4d99-aa3c-8354dc825a63 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:26:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXzaMGSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:33 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:26:33 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:26:33 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e3897-9f15-4bf5-9583-4e3ed44dc812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:26:33 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ffbdc2-4bc0-4fff-a4b0-04096acd6c7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068] added
Nov 15 01:26:33 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff27ff2-0a47-4dd4-9bfa-fe74a337d376]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9054f-e219-4dad-bd53-518952e07208]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXzaMGSA {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXzaMGSA" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fca96ea-c5a6-435f-8beb-98703360b7d0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXzaMGSA'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4721e505-f166-4f1a-84f2-fb0c90b94da1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8600bb-0971-4612-a3cb-42c0db077958]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:34 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:34 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb911376-ec61-4543-aa84-1d904498e2dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260]
Nov 15 01:26:34 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260] successful.
Nov 15 01:26:34 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce995a-0fea-4fc8-a122-fb0f328f2f7a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c53ccc-f0d6-44c2-beb7-8250d60ecbbf]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:34 user nova-compute[74880]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)
Nov 15 01:26:34 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f8f3a1-6431-4698-9bef-c0f5eace4514]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXzaMGSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:26:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26164346232663334', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164346232663334', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG nova.objects.instance [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'flavor' on Instance uuid 97877ac2-ab65-413a-96a1-928847c8a0a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:26:35 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:26:35 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:26:35 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:26:35 user nova-compute[74880]:   <serial>217f57f2-c3a0-4bec-a62c-9e4024afd068</serial>
Nov 15 01:26:35 user nova-compute[74880]: </disk>
Nov 15 01:26:35 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] No VIF found with MAC fa:16:3e:56:05:68, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:26:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eff04824-896e-4b05-817e-c13daf70ac2e tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.882s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:37 user nova-compute[74880]: INFO nova.compute.manager [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Detaching volume 217f57f2-c3a0-4bec-a62c-9e4024afd068
Nov 15 01:26:37 user nova-compute[74880]: INFO nova.virt.block_device [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Attempting to driver detach volume 217f57f2-c3a0-4bec-a62c-9e4024afd068 from mountpoint /dev/vdb
Nov 15 01:26:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Attempting to detach device vdb from instance 97877ac2-ab65-413a-96a1-928847c8a0a8 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:26:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:26:37 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:26:37 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:26:37 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:26:37 user nova-compute[74880]:   <serial>217f57f2-c3a0-4bec-a62c-9e4024afd068</serial>
Nov 15 01:26:37 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:26:37 user nova-compute[74880]: </disk>
Nov 15 01:26:37 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:26:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully detached device vdb from instance 97877ac2-ab65-413a-96a1-928847c8a0a8 from the persistent domain config.
Nov 15 01:26:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97877ac2-ab65-413a-96a1-928847c8a0a8 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:26:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:26:37 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:26:37 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:26:37 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:26:37 user nova-compute[74880]:   <serial>217f57f2-c3a0-4bec-a62c-9e4024afd068</serial>
Nov 15 01:26:37 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:26:37 user nova-compute[74880]: </disk>
Nov 15 01:26:37 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:26:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97877ac2-ab65-413a-96a1-928847c8a0a8 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:26:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:39 user nova-compute[74880]: INFO nova.compute.manager [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Terminating instance
Nov 15 01:26:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-a528f08d-493f-41c3-811a-f4b4035b899a req-87809cd7-3cce-423e-8fe6-0df230e3b38d service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a528f08d-493f-41c3-811a-f4b4035b899a req-87809cd7-3cce-423e-8fe6-0df230e3b38d service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a528f08d-493f-41c3-811a-f4b4035b899a req-87809cd7-3cce-423e-8fe6-0df230e3b38d service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a528f08d-493f-41c3-811a-f4b4035b899a req-87809cd7-3cce-423e-8fe6-0df230e3b38d service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-a528f08d-493f-41c3-811a-f4b4035b899a req-87809cd7-3cce-423e-8fe6-0df230e3b38d service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-a528f08d-493f-41c3-811a-f4b4035b899a req-87809cd7-3cce-423e-8fe6-0df230e3b38d service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-unplugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Instance destroyed successfully.
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lazy-loading 'resources' on Instance uuid 00eda474-3fbc-45ce-8986-6e8cbb90bd2d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1351279143',display_name='tempest-ServerActionsTestOtherB-server-1351279143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1351279143',id=17,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzI+lzq22EUJY7rLcDyX1/HYfJjBOFz6yDELnWy6VcS6IQsz9uU791j4QrrdjGvXtMXl9G6WoUWjMbvFFmwwXm+3HSEI7NDaiqvE75X0sM2mHCVubx3iOk7OpcLziyu7A==',key_name='tempest-keypair-1580262869',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b855ee7bc0e344ac836b02b1e86c3798',ramdisk_id='',reservation_id='r-l3vfulm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-230839994',owner_user_name='tempest-ServerActionsTestOtherB-230839994-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa7a9a3c7994818bee910e2bf0e6043',uuid=00eda474-3fbc-45ce-8986-6e8cbb90bd2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converting VIF {"id": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "address": "fa:16:3e:0f:db:87", "network": {"id": "5acb5b5c-a6d2-4151-98b3-db5e2f14bd29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1867375276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b855ee7bc0e344ac836b02b1e86c3798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe814ba-5e", "ovs_interfaceid": "6fe814ba-5ec3-4038-9d2e-694980cd4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_vif [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fe814ba-5e, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50d826b1-2e35-452c-bf7f-f765d90d9a99) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: INFO os_vif [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:db:87,bridge_name='br-int',has_traffic_filtering=True,id=6fe814ba-5ec3-4038-9d2e-694980cd4ed3,network=Network(5acb5b5c-a6d2-4151-98b3-db5e2f14bd29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe814ba-5e')
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzapVJQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:40 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a45947-5ef5-4d7e-b3c3-5e8c41daba3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:26:40 user nova-compute[74880]: No targets found.
Nov 15 01:26:40 user nova-compute[74880]: iSNS:
Nov 15 01:26:40 user nova-compute[74880]: No targets found.
Nov 15 01:26:40 user nova-compute[74880]: STATIC:
Nov 15 01:26:40 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9
Nov 15 01:26:40 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:40 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:40 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068
Nov 15 01:26:40 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:40 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:40 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:26:40 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:40 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:40 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:26:40 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:40 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:40 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:26:40 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:40 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:40 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:26:40 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:40 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:40 user nova-compute[74880]: FIRMWARE:
Nov 15 01:26:40 user nova-compute[74880]: No targets found.
Nov 15 01:26:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:26:40 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:26:40 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[212bbe09-6195-48de-b16b-15f0036707ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5cb506-bd7f-41a7-8694-1fba1d80842d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)
Nov 15 01:26:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:40 user nova-compute[74880]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)
Nov 15 01:26:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f95081893f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0170f62b-f810-4cc3-baa1-bc273a27ef4e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[789cf7e7-8e5b-41aa-8faa-665a94633d1e]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[60723b54-c57b-47cf-9b23-920aab00f0ee]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.079s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfbbc1f-f010-441b-b060-8dd4dcc8e045]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed97c410-19ae-4861-9ee4-4645fcb69f7f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0849e190-96c0-40e3-9ffb-ded5caf478a8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260]
Nov 15 01:26:40 user nova-compute[74880]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9, portal: 172.16.0.220,3260] successful.
Nov 15 01:26:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ed8b916-c70c-4ec7-8424-efb9d161d7e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b082473-4c4d-49c6-b347-e3d8f0d20b82]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] <== disconnect_volume: return (383ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:26:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Deleting instance files /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d_del
Nov 15 01:26:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Deletion of /opt/stack/data/nova/instances/00eda474-3fbc-45ce-8986-6e8cbb90bd2d_del complete
Nov 15 01:26:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:40 user nova-compute[74880]: INFO nova.compute.manager [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 15 01:26:40 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:26:40 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:26:41 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:41 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Took 0.66 seconds to deallocate network for instance.
Nov 15 01:26:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] Acquiring lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] No waiting events found dispatching network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:42 user nova-compute[74880]: WARNING nova.compute.manager [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received unexpected event network-vif-plugged-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 for instance with vm_state active and task_state deleting.
Nov 15 01:26:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-0b800717-de7b-4439-89e5-0b118319636a req-f8e2537d-fad5-4fed-b9c8-4b21fe256289 service nova] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Received event network-vif-deleted-6fe814ba-5ec3-4038-9d2e-694980cd4ed3 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:42 user nova-compute[74880]: INFO nova.compute.manager [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] [instance: 00eda474-3fbc-45ce-8986-6e8cbb90bd2d] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:42 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Deleted allocations for instance 00eda474-3fbc-45ce-8986-6e8cbb90bd2d
Nov 15 01:26:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6ebdef7-caa7-42d8-9ccb-6d6ec79dc7cf tempest-ServerActionsTestOtherB-230839994 tempest-ServerActionsTestOtherB-230839994-project-member] Lock "00eda474-3fbc-45ce-8986-6e8cbb90bd2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.433s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:46 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "f2414209-8acf-4587-b277-00e244fe6d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:26:48 user nova-compute[74880]: INFO nova.compute.claims [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Claim successful on node user
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.101s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:26:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:26:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:26:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:26:49 user nova-compute[74880]: INFO nova.virt.block_device [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Booting with volume snapshot 4589fd6a-9b12-45f7-9e65-37101dadef38 at /dev/vda
Nov 15 01:26:49 user nova-compute[74880]: DEBUG nova.policy [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '484f6e472b2c4cb588dfab3cc9d3932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c2385409b4f5080bf3d81430ddbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Successfully created port: f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Successfully updated port: f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "refresh_cache-f2414209-8acf-4587-b277-00e244fe6d2f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquired lock "refresh_cache-f2414209-8acf-4587-b277-00e244fe6d2f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-changed-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Refreshing instance network info cache due to event network-changed-f59b1558-c1e6-40df-9781-5e12c24dedcc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] Acquiring lock "refresh_cache-f2414209-8acf-4587-b277-00e244fe6d2f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Updating instance_info_cache with network_info: [{"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Releasing lock "refresh_cache-f2414209-8acf-4587-b277-00e244fe6d2f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Instance network_info: |[{"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] Acquired lock "refresh_cache-f2414209-8acf-4587-b277-00e244fe6d2f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Refreshing network info cache for port f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Updated VIF entry in instance network info cache for port f59b1558-c1e6-40df-9781-5e12c24dedcc. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Updating instance_info_cache with network_info: [{"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d345f33e-ebda-4eec-8311-28a5c882ccc3 req-7de69b47-aa58-42d1-9d61-144d19b5dd7f service nova] Releasing lock "refresh_cache-f2414209-8acf-4587-b277-00e244fe6d2f" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:26:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7512MB free_disk=25.289409637451172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 88540810-db28-4f01-aa45-5cc4497214e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 97877ac2-ab65-413a-96a1-928847c8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance b73970f1-764f-46ed-a25a-b5418a91b17b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f2414209-8acf-4587-b277-00e244fe6d2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:26:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:26:54 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:26:54 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:26:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:26:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG os_brick.utils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f4e15-b438-4c9b-8ed7-501174b3c320]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[925dcb34-e2b6-46a9-a818-29bc00adfe6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7af36a-f1ae-4c8d-86e1-629b59cf3075]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ab1d4-f354-41a2-a9fa-74941e776e85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:26:55 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:26:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bfef3f-4608-4968-a902-eb2080b426af]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG os_brick.utils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Updating existing volume attachment record: 0ad56e32-fdcc-4e1f-a44e-7d1aa47613cd {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:26:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [{"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-fc9fe17c-b782-44d0-8adc-3c42fde5af94" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:56 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:26:56 user nova-compute[74880]: INFO nova.compute.claims [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Claim successful on node user
Nov 15 01:26:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:26:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.policy [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51e98c9ec2b54c2eba8c826f1d030a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390def18dc1643a5ac9b7b8802f0d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:26:57 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Creating image(s)
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "/opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "/opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "/opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk 1073741824" returned: 0 in 0.052s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Successfully created port: 90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.234s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:58 user nova-compute[74880]: INFO nova.compute.manager [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Terminating instance
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:26:58 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97877ac2-ab65-413a-96a1-928847c8a0a8 is timed out.
Nov 15 01:26:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully detached device vdb from instance 97877ac2-ab65-413a-96a1-928847c8a0a8 from the live domain config.
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXzaMGSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:26:58 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Cannot resize image /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Ensure instance console log exists: /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f755fd99-9f29-471d-b9fc-b3330a572b18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:26:58 user nova-compute[74880]: No targets found.
Nov 15 01:26:58 user nova-compute[74880]: iSNS:
Nov 15 01:26:58 user nova-compute[74880]: No targets found.
Nov 15 01:26:58 user nova-compute[74880]: STATIC:
Nov 15 01:26:58 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068
Nov 15 01:26:58 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:58 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:58 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:26:58 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:58 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:58 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:26:58 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:58 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:58 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:26:58 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:58 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:58 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:26:58 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:26:58 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:26:58 user nova-compute[74880]: FIRMWARE:
Nov 15 01:26:58 user nova-compute[74880]: No targets found.
Nov 15 01:26:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:26:58 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:26:58 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9868f2f2-6b38-4133-98a1-e1bfd7910827]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527f205-707f-4bb1-80a0-4c6c6ad840cf]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)
Nov 15 01:26:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:26:58 user nova-compute[74880]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 (non-flash)
Nov 15 01:26:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01f0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b99a9ba-aff4-4e55-9722-1487e2c4b203]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2083ccf8-c27c-4250-9750-8a9cc1f087dd]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e822dc-216f-44e8-b001-c6ce898b1df0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b95e9a-754c-4299-91ee-9009fbcf8d42]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[735fa69a-d2a0-4011-b720-7d59bc4a6d09]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec0253-0b46-4dca-9102-ca314bc473d5]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260]
Nov 15 01:26:58 user nova-compute[74880]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068, portal: 172.16.0.220,3260] successful.
Nov 15 01:26:58 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217f57f2-c3a0-4bec-a62c-9e4024afd068 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf965f8-0efb-4d1b-b2de-f92874cce7af]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] <== disconnect_volume: return (340ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-0c6b685c-ebb1-4d5c-8950-7c27f1ff023c req-d8ba34a1-84ad-4a6f-ab04-e4a0847c8f4f service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-vif-unplugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0c6b685c-ebb1-4d5c-8950-7c27f1ff023c req-d8ba34a1-84ad-4a6f-ab04-e4a0847c8f4f service nova] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0c6b685c-ebb1-4d5c-8950-7c27f1ff023c req-d8ba34a1-84ad-4a6f-ab04-e4a0847c8f4f service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0c6b685c-ebb1-4d5c-8950-7c27f1ff023c req-d8ba34a1-84ad-4a6f-ab04-e4a0847c8f4f service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-0c6b685c-ebb1-4d5c-8950-7c27f1ff023c req-d8ba34a1-84ad-4a6f-ab04-e4a0847c8f4f service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] No waiting events found dispatching network-vif-unplugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:26:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-0c6b685c-ebb1-4d5c-8950-7c27f1ff023c req-d8ba34a1-84ad-4a6f-ab04-e4a0847c8f4f service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-vif-unplugged-54073e75-8725-41be-9f44-4bfc22410dc1 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Successfully updated port: 90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquired lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:26:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Instance destroyed successfully.
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lazy-loading 'resources' on Instance uuid 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-54928049',display_name='tempest-VolumesActionsTest-instance-54928049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-54928049',id=29,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9227eed50873467fa2d81608d5f77978',ramdisk_id='',reservation_id='r-lzsvdbez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-565390894',owner_user_name='tempest-VolumesActionsTest-565390894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:25:14Z,user_data=None,user_id='8105ea094961417982de5311ecff7635',uuid=5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converting VIF {"id": "54073e75-8725-41be-9f44-4bfc22410dc1", "address": "fa:16:3e:bd:a7:38", "network": {"id": "ae805828-4b29-477c-8209-77ca3b326a73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2014109249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9227eed50873467fa2d81608d5f77978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54073e75-87", "ovs_interfaceid": "54073e75-8725-41be-9f44-4bfc22410dc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG os_vif [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54073e75-87, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d14abfcc-fa21-418e-babd-8d5fbbb2a411) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: INFO os_vif [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a7:38,bridge_name='br-int',has_traffic_filtering=True,id=54073e75-8725-41be-9f44-4bfc22410dc1,network=Network(ae805828-4b29-477c-8209-77ca3b326a73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54073e75-87')
Nov 15 01:26:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Deleting instance files /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7_del
Nov 15 01:26:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Deletion of /opt/stack/data/nova/instances/5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7_del complete
Nov 15 01:26:59 user nova-compute[74880]: INFO nova.compute.manager [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'flavor' on Instance uuid 97877ac2-ab65-413a-96a1-928847c8a0a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating instance_info_cache with network_info: [{"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c5dd77d7-e631-42ee-af42-da62fd0089c9 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Releasing lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Instance network_info: |[{"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Start _get_guest_xml network_info=[{"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:26:59 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:26:59 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1149569759',display_name='tempest-SnapshotDataIntegrityTests-server-1149569759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1149569759',id=33,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrYM0uqon58XfHuzF8o/XxPTEePC8hmDzp7VCzIfBvUI5lkHs+T3I1TReOFDA/oxxt33hKSd/gKcmDw28+smGCm77LgVsrdF3RvZV6PR+wshKcgnQi1Fs3JApjezuCY/Q==',key_name='tempest-keypair-1795074059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='390def18dc1643a5ac9b7b8802f0d625',ramdisk_id='',reservation_id='r-jgt1339k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-581673142',owner_user_name='tempest-SnapshotDataIntegrityTests-581673142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e98c9ec2b54c2eba8c826f1d030a51',uuid=11ebe5fe-f476-4a7b-ace2-b62e377c5b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Converting VIF {"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'pci_devices' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:26:59 user nova-compute[74880]:   <uuid>11ebe5fe-f476-4a7b-ace2-b62e377c5b84</uuid>
Nov 15 01:26:59 user nova-compute[74880]:   <name>instance-00000021</name>
Nov 15 01:26:59 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:26:59 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:26:59 user nova-compute[74880]:   <metadata>
Nov 15 01:26:59 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:26:59 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:26:59 user nova-compute[74880]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1149569759</nova:name>
Nov 15 01:26:59 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:26:59</nova:creationTime>
Nov 15 01:26:59 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:26:59 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:26:59 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:26:59 user nova-compute[74880]:       <nova:owner>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:user uuid="51e98c9ec2b54c2eba8c826f1d030a51">tempest-SnapshotDataIntegrityTests-581673142-project-member</nova:user>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:project uuid="390def18dc1643a5ac9b7b8802f0d625">tempest-SnapshotDataIntegrityTests-581673142</nova:project>
Nov 15 01:26:59 user nova-compute[74880]:       </nova:owner>
Nov 15 01:26:59 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:26:59 user nova-compute[74880]:       <nova:ports>
Nov 15 01:26:59 user nova-compute[74880]:         <nova:port uuid="90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b">
Nov 15 01:26:59 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:26:59 user nova-compute[74880]:         </nova:port>
Nov 15 01:26:59 user nova-compute[74880]:       </nova:ports>
Nov 15 01:26:59 user nova-compute[74880]:     </nova:instance>
Nov 15 01:26:59 user nova-compute[74880]:   </metadata>
Nov 15 01:26:59 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:26:59 user nova-compute[74880]:     <system>
Nov 15 01:26:59 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:26:59 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:26:59 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:26:59 user nova-compute[74880]:       <entry name="serial">11ebe5fe-f476-4a7b-ace2-b62e377c5b84</entry>
Nov 15 01:26:59 user nova-compute[74880]:       <entry name="uuid">11ebe5fe-f476-4a7b-ace2-b62e377c5b84</entry>
Nov 15 01:26:59 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:26:59 user nova-compute[74880]:     </system>
Nov 15 01:26:59 user nova-compute[74880]:   </sysinfo>
Nov 15 01:26:59 user nova-compute[74880]:   <os>
Nov 15 01:26:59 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:26:59 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:26:59 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:26:59 user nova-compute[74880]:   </os>
Nov 15 01:26:59 user nova-compute[74880]:   <features>
Nov 15 01:26:59 user nova-compute[74880]:     <acpi/>
Nov 15 01:26:59 user nova-compute[74880]:     <apic/>
Nov 15 01:26:59 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:26:59 user nova-compute[74880]:   </features>
Nov 15 01:26:59 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:26:59 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:26:59 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:26:59 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:26:59 user nova-compute[74880]:   </clock>
Nov 15 01:26:59 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:26:59 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:26:59 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:26:59 user nova-compute[74880]:   </cpu>
Nov 15 01:26:59 user nova-compute[74880]:   <devices>
Nov 15 01:26:59 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:26:59 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:26:59 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk"/>
Nov 15 01:26:59 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:26:59 user nova-compute[74880]:     </disk>
Nov 15 01:26:59 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:26:59 user nova-compute[74880]:       <mac address="fa:16:3e:cf:05:d9"/>
Nov 15 01:26:59 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:26:59 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:26:59 user nova-compute[74880]:       <target dev="tap90fb1c7f-7e"/>
Nov 15 01:26:59 user nova-compute[74880]:     </interface>
Nov 15 01:26:59 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:26:59 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/console.log" append="off"/>
Nov 15 01:26:59 user nova-compute[74880]:     </serial>
Nov 15 01:26:59 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:26:59 user nova-compute[74880]:     <video>
Nov 15 01:26:59 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:26:59 user nova-compute[74880]:     </video>
Nov 15 01:26:59 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:26:59 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:26:59 user nova-compute[74880]:     </rng>
Nov 15 01:26:59 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:26:59 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:26:59 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:26:59 user nova-compute[74880]:     </memballoon>
Nov 15 01:26:59 user nova-compute[74880]:   </devices>
Nov 15 01:26:59 user nova-compute[74880]: </domain>
Nov 15 01:26:59 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1149569759',display_name='tempest-SnapshotDataIntegrityTests-server-1149569759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1149569759',id=33,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrYM0uqon58XfHuzF8o/XxPTEePC8hmDzp7VCzIfBvUI5lkHs+T3I1TReOFDA/oxxt33hKSd/gKcmDw28+smGCm77LgVsrdF3RvZV6PR+wshKcgnQi1Fs3JApjezuCY/Q==',key_name='tempest-keypair-1795074059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='390def18dc1643a5ac9b7b8802f0d625',ramdisk_id='',reservation_id='r-jgt1339k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-581673142',owner_user_name='tempest-SnapshotDataIntegrityTests-581673142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e98c9ec2b54c2eba8c826f1d030a51',uuid=11ebe5fe-f476-4a7b-ace2-b62e377c5b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Converting VIF {"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG os_vif [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb4d8390-6f3b-51ac-b99b-313d8f7c119d', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90fb1c7f-7e, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90fb1c7f-7e, col_values=(('qos', UUID('0accd380-5ae0-4ef5-aa0d-9292562a7a65')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90fb1c7f-7e, col_values=(('external_ids', {'iface-id': '90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:05:d9', 'vm-uuid': '11ebe5fe-f476-4a7b-ace2-b62e377c5b84'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:26:59 user nova-compute[74880]: INFO os_vif [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e')
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No VIF found with MAC fa:16:3e:cf:05:d9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:26:59 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Took 0.52 seconds to deallocate network for instance.
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:26:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:27:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Creating image(s)
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2414209-8acf-4587-b277-00e244fe6d2f/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Start _get_guest_xml network_info=[{"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhwNDyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2414209-8acf-4587-b277-00e244fe6d2f', 'attached_at': '', 'detached_at': '', 'volume_id': '6687dea9-b816-4785-910b-471e357fb093', 'serial': '6687dea9-b816-4785-910b-471e357fb093'}, 'mount_device': '/dev/vda', 'attachment_id': '0ad56e32-fdcc-4e1f-a44e-7d1aa47613cd', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:27:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhwNDyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:27:00 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:00 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:00 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f7dc9d-38e6-48db-8a4c-94ed6945c775]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:27:00 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4a2533-b9a6-4fac-878e-7aed05c6ff11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093] added
Nov 15 01:27:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[44feb828-f031-44de-a1c2-806c8d9fc02d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94a8a0-3bd0-4200-a2a3-b12f7d2ecc0c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKhwNDyU {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKhwNDyU" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca66980-0f6e-4db3-8e14-92dee8d599b6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKhwNDyU'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d6a28-8663-4a8e-9132-959ba975fc8f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Deleted allocations for instance 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606d9d0-5c1e-48ea-9e75-d3c5c2ee4c9e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4a163ed3-eb27-4efa-8123-e6c5b2e57580 tempest-VolumesActionsTest-565390894 tempest-VolumesActionsTest-565390894-project-member] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f18f37-3854-4597-bf2c-745149083057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260]
Nov 15 01:27:00 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260] successful.
Nov 15 01:27:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d928a-b927-45a1-8de7-b6328b26e439]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c16a15-4d30-4772-a9cb-6e4046197611]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:00 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa092515-18a9-4da3-af14-63bb267da93c]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-changed-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Refreshing instance network info cache due to event network-changed-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] Acquiring lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] Acquired lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:00 user nova-compute[74880]: DEBUG nova.network.neutron [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Refreshing network info cache for port 90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhwNDyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23534333463663131', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534333463663131', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1606982935',display_name='tempest-TestVolumeBootPattern-server-1606982935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1606982935',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-wffixqmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:49Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=f2414209-8acf-4587-b277-00e244fe6d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'pci_devices' on Instance uuid f2414209-8acf-4587-b277-00e244fe6d2f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:27:01 user nova-compute[74880]:   <uuid>f2414209-8acf-4587-b277-00e244fe6d2f</uuid>
Nov 15 01:27:01 user nova-compute[74880]:   <name>instance-00000020</name>
Nov 15 01:27:01 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:27:01 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:27:01 user nova-compute[74880]:   <metadata>
Nov 15 01:27:01 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:27:01 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:27:01 user nova-compute[74880]:       <nova:name>tempest-TestVolumeBootPattern-server-1606982935</nova:name>
Nov 15 01:27:01 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:27:00</nova:creationTime>
Nov 15 01:27:01 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:27:01 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:27:01 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:27:01 user nova-compute[74880]:       <nova:owner>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:user uuid="484f6e472b2c4cb588dfab3cc9d3932a">tempest-TestVolumeBootPattern-1434286508-project-member</nova:user>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:project uuid="861c2385409b4f5080bf3d81430ddbf0">tempest-TestVolumeBootPattern-1434286508</nova:project>
Nov 15 01:27:01 user nova-compute[74880]:       </nova:owner>
Nov 15 01:27:01 user nova-compute[74880]:       <nova:ports>
Nov 15 01:27:01 user nova-compute[74880]:         <nova:port uuid="f59b1558-c1e6-40df-9781-5e12c24dedcc">
Nov 15 01:27:01 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 01:27:01 user nova-compute[74880]:         </nova:port>
Nov 15 01:27:01 user nova-compute[74880]:       </nova:ports>
Nov 15 01:27:01 user nova-compute[74880]:     </nova:instance>
Nov 15 01:27:01 user nova-compute[74880]:   </metadata>
Nov 15 01:27:01 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:27:01 user nova-compute[74880]:     <system>
Nov 15 01:27:01 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:27:01 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:27:01 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:27:01 user nova-compute[74880]:       <entry name="serial">f2414209-8acf-4587-b277-00e244fe6d2f</entry>
Nov 15 01:27:01 user nova-compute[74880]:       <entry name="uuid">f2414209-8acf-4587-b277-00e244fe6d2f</entry>
Nov 15 01:27:01 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:27:01 user nova-compute[74880]:     </system>
Nov 15 01:27:01 user nova-compute[74880]:   </sysinfo>
Nov 15 01:27:01 user nova-compute[74880]:   <os>
Nov 15 01:27:01 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:27:01 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:27:01 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:27:01 user nova-compute[74880]:   </os>
Nov 15 01:27:01 user nova-compute[74880]:   <features>
Nov 15 01:27:01 user nova-compute[74880]:     <acpi/>
Nov 15 01:27:01 user nova-compute[74880]:     <apic/>
Nov 15 01:27:01 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:27:01 user nova-compute[74880]:   </features>
Nov 15 01:27:01 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:27:01 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:27:01 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:27:01 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:27:01 user nova-compute[74880]:   </clock>
Nov 15 01:27:01 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:27:01 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:27:01 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:27:01 user nova-compute[74880]:   </cpu>
Nov 15 01:27:01 user nova-compute[74880]:   <devices>
Nov 15 01:27:01 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:27:01 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:27:01 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:27:01 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:27:01 user nova-compute[74880]:       <serial>6687dea9-b816-4785-910b-471e357fb093</serial>
Nov 15 01:27:01 user nova-compute[74880]:     </disk>
Nov 15 01:27:01 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:27:01 user nova-compute[74880]:       <mac address="fa:16:3e:cf:35:32"/>
Nov 15 01:27:01 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:01 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:27:01 user nova-compute[74880]:       <target dev="tapf59b1558-c1"/>
Nov 15 01:27:01 user nova-compute[74880]:     </interface>
Nov 15 01:27:01 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:27:01 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/f2414209-8acf-4587-b277-00e244fe6d2f/console.log" append="off"/>
Nov 15 01:27:01 user nova-compute[74880]:     </serial>
Nov 15 01:27:01 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:27:01 user nova-compute[74880]:     <video>
Nov 15 01:27:01 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:01 user nova-compute[74880]:     </video>
Nov 15 01:27:01 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:27:01 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:27:01 user nova-compute[74880]:     </rng>
Nov 15 01:27:01 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:27:01 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:27:01 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:27:01 user nova-compute[74880]:     </memballoon>
Nov 15 01:27:01 user nova-compute[74880]:   </devices>
Nov 15 01:27:01 user nova-compute[74880]: </domain>
Nov 15 01:27:01 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1606982935',display_name='tempest-TestVolumeBootPattern-server-1606982935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1606982935',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-wffixqmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:49Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=f2414209-8acf-4587-b277-00e244fe6d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG os_vif [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4438bcd7-a7e7-5988-90e8-2f46353f7856', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf59b1558-c1, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf59b1558-c1, col_values=(('qos', UUID('503faa4f-cb22-4681-bafe-37b7cadbe17b')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf59b1558-c1, col_values=(('external_ids', {'iface-id': 'f59b1558-c1e6-40df-9781-5e12c24dedcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:35:32', 'vm-uuid': 'f2414209-8acf-4587-b277-00e244fe6d2f'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:02 user nova-compute[74880]: INFO os_vif [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1')
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updated VIF entry in instance network info cache for port 90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating instance_info_cache with network_info: [{"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] Releasing lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] Acquiring lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] Lock "5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] No waiting events found dispatching network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:02 user nova-compute[74880]: WARNING nova.compute.manager [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received unexpected event network-vif-plugged-54073e75-8725-41be-9f44-4bfc22410dc1 for instance with vm_state deleted and task_state None.
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-b3b10771-d2e9-4373-80dc-1d70ffab197b req-aa8935ea-d90f-4e62-99f1-3332d2641756 service nova] [instance: 5840fbc4-8f7c-4d72-a0a1-68cb178a2bd7] Received event network-vif-deleted-54073e75-8725-41be-9f44-4bfc22410dc1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No VIF found with MAC fa:16:3e:cf:35:32, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] No waiting events found dispatching network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:02 user nova-compute[74880]: WARNING nova.compute.manager [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received unexpected event network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b for instance with vm_state building and task_state spawning.
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] No waiting events found dispatching network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:02 user nova-compute[74880]: WARNING nova.compute.manager [req-7904519d-0eef-472a-bd65-fb3ace409cac req-f192a072-9666-4ee3-85c3-673e9c74a850 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received unexpected event network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b for instance with vm_state building and task_state spawning.
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:27:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Instance spawned successfully.
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:03 user nova-compute[74880]: INFO nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:27:03 user nova-compute[74880]: INFO nova.compute.manager [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Took 6.63 seconds to build instance.
Nov 15 01:27:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5d81fccb-7bcc-4315-b10e-2c4e44ce438d tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.732s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fefa806-2984-45a6-bf81-774a1ee6e66e req-9429878f-accb-4b77-97f2-65f8a50b2155 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fefa806-2984-45a6-bf81-774a1ee6e66e req-9429878f-accb-4b77-97f2-65f8a50b2155 service nova] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fefa806-2984-45a6-bf81-774a1ee6e66e req-9429878f-accb-4b77-97f2-65f8a50b2155 service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fefa806-2984-45a6-bf81-774a1ee6e66e req-9429878f-accb-4b77-97f2-65f8a50b2155 service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fefa806-2984-45a6-bf81-774a1ee6e66e req-9429878f-accb-4b77-97f2-65f8a50b2155 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] No waiting events found dispatching network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:03 user nova-compute[74880]: WARNING nova.compute.manager [req-7fefa806-2984-45a6-bf81-774a1ee6e66e req-9429878f-accb-4b77-97f2-65f8a50b2155 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received unexpected event network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc for instance with vm_state building and task_state spawning.
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:27:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Instance spawned successfully.
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] No waiting events found dispatching network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:05 user nova-compute[74880]: WARNING nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received unexpected event network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc for instance with vm_state building and task_state spawning.
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-changed-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Refreshing instance network info cache due to event network-changed-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Refreshing network info cache for port dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:05 user nova-compute[74880]: INFO nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 15 01:27:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:27:05 user nova-compute[74880]: INFO nova.compute.manager [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Took 17.44 seconds to build instance.
Nov 15 01:27:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f6cc1f52-3948-4f97-9cd4-99c4c3c94cee tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "f2414209-8acf-4587-b277-00e244fe6d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.548s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated VIF entry in instance network info cache for port dc4a6925-6a3f-47fc-a0df-0a77d9f5927b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-changed-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Refreshing instance network info cache due to event network-changed-64bd0957-7c1f-4660-b3ff-2445d6af85d6. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Refreshing network info cache for port 64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updated VIF entry in instance network info cache for port 64bd0957-7c1f-4660-b3ff-2445d6af85d6. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-57ffae14-f8e7-4a91-8be7-14f82077026c req-b2e32159-0b82-4ac9-ba52-2c54f731284b service nova] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Stashing vm_state: active {{(pid=74880) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:27:07 user nova-compute[74880]: INFO nova.compute.claims [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Claim successful on node user
Nov 15 01:27:07 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating resource usage from migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7
Nov 15 01:27:07 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.457s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:07 user nova-compute[74880]: INFO nova.compute.manager [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Migrating
Nov 15 01:27:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Starting migrate_disk_and_power_off {{(pid=74880) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-08341533-8803-4bef-8eb9-0852605615cb req-fe1b4de1-50ff-40c7-acba-fca1b7ff887a service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-unplugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-08341533-8803-4bef-8eb9-0852605615cb req-fe1b4de1-50ff-40c7-acba-fca1b7ff887a service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-08341533-8803-4bef-8eb9-0852605615cb req-fe1b4de1-50ff-40c7-acba-fca1b7ff887a service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-08341533-8803-4bef-8eb9-0852605615cb req-fe1b4de1-50ff-40c7-acba-fca1b7ff887a service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-08341533-8803-4bef-8eb9-0852605615cb req-fe1b4de1-50ff-40c7-acba-fca1b7ff887a service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-unplugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:08 user nova-compute[74880]: WARNING nova.compute.manager [req-08341533-8803-4bef-8eb9-0852605615cb req-fe1b4de1-50ff-40c7-acba-fca1b7ff887a service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-unplugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state active and task_state resize_migrating.
Nov 15 01:27:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance destroyed successfully.
Nov 15 01:27:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-748895696',display_name='tempest-ServerActionsTestOtherA-server-748895696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-748895696',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-e3ryz9gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=b73970f1-764f-46ed-a25a-b5418a91b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64bd0957-7c, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4424caa-eed7-45a8-9f21-d8402a5a652c) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:09 user nova-compute[74880]: INFO os_vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c')
Nov 15 01:27:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:27:09 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d5da1b-1899-4622-a41f-a45cbd4b1054]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:27:09 user nova-compute[74880]: No targets found.
Nov 15 01:27:09 user nova-compute[74880]: iSNS:
Nov 15 01:27:09 user nova-compute[74880]: No targets found.
Nov 15 01:27:09 user nova-compute[74880]: STATIC:
Nov 15 01:27:09 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:27:09 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:09 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:09 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:27:09 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:09 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:09 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:27:09 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:09 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:09 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093
Nov 15 01:27:09 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:09 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:09 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:27:09 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:09 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:09 user nova-compute[74880]: FIRMWARE:
Nov 15 01:27:09 user nova-compute[74880]: No targets found.
Nov 15 01:27:09 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:27:09 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:27:09 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc6a16-7852-4a7c-a1b3-58b6b45d21e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca130eb-a579-4224-9a0e-744bee632d41]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:09 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:09 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:09 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d063e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07831c-c534-434a-b71b-16bb446efdc0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c7640a-9cff-4029-a4e0-53bd29f54144]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0feb2-6bdb-46b1-85fb-57800b914dc7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6635b4-6c99-4cc8-ac36-1a0991c8d3b4]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c09c9-0b80-4229-a7be-f66827664deb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc1e7b5-03fa-454d-b6b8-2583cd240d6c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]
Nov 15 01:27:09 user nova-compute[74880]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.
Nov 15 01:27:09 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[14af9b94-9801-4472-843b-07939bb02b39]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== disconnect_volume: return (344ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:27:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-5b5e2175-a81c-45ad-b543-84d63bba434c req-82d46aa9-b49e-455f-96a0-5eaaae41234d service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b5e2175-a81c-45ad-b543-84d63bba434c req-82d46aa9-b49e-455f-96a0-5eaaae41234d service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b5e2175-a81c-45ad-b543-84d63bba434c req-82d46aa9-b49e-455f-96a0-5eaaae41234d service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b5e2175-a81c-45ad-b543-84d63bba434c req-82d46aa9-b49e-455f-96a0-5eaaae41234d service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-5b5e2175-a81c-45ad-b543-84d63bba434c req-82d46aa9-b49e-455f-96a0-5eaaae41234d service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:10 user nova-compute[74880]: WARNING nova.compute.manager [req-5b5e2175-a81c-45ad-b543-84d63bba434c req-82d46aa9-b49e-455f-96a0-5eaaae41234d service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state active and task_state resize_migrating.
Nov 15 01:27:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Port 64bd0957-7c1f-4660-b3ff-2445d6af85d6 binding to destination host user is already ACTIVE {{(pid=74880) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG os_brick.utils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[444aa4e1-7512-4560-ac4c-6626c1ea011e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92329aee-b005-4e35-b77c-3acb1d945b13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed31adc3-2ef2-49bd-9be1-a0118e33c979]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0b4d5-f267-42e8-93fc-dbad8428c066]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:27:11 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:27:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a11272-5030-4174-9394-9609b4db315b]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:27:11 user nova-compute[74880]: DEBUG os_brick.utils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:27:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Starting finish_migration {{(pid=74880) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:27:16 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Creating image(s)
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Ensure instance console log exists: /opt/stack/data/nova/instances/b73970f1-764f-46ed-a25a-b5418a91b17b/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Start _get_guest_xml network_info=[{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b73970f1-764f-46ed-a25a-b5418a91b17b', 'attached_at': '2023-11-15T01:27:16.000000', 'detached_at': '', 'volume_id': '7397a78f-439d-4d7e-8175-2518aef395ef', 'serial': '7397a78f-439d-4d7e-8175-2518aef395ef'}, 'mount_device': '/dev/vda', 'attachment_id': '1e2d767a-ad83-478c-841d-50fea0f9317a', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:27:16 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:16 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:27:16 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:16 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:16 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[657fb22d-8604-4970-93be-956ce0269999]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:27:16 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ba4bd-a00f-44eb-862b-2bdbe8f18f84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef] added
Nov 15 01:27:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd28a7a-fc69-4993-bc10-571b254c943b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d79d515-5515-4de9-a25a-093934116f80]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFQZlLof {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFQZlLof" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3da9f-cc71-4729-86e0-39a01bfcdc05]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFQZlLof'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48c208f-38c9-4da8-82fd-079713bb9673]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[44780663-2765-4ef2-83ed-209d19ddbb5f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf137ae-4dc0-4273-beee-5f2975bf25e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]
Nov 15 01:27:16 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.
Nov 15 01:27:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f773a5-7b55-4986-9f65-91e76d14f49b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9eae2f-df69-44d4-b0cf-b3bc168e3045]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:16 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2342455-b111-4038-9bb7-5db4c867d6e3]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:27:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquired lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.network.neutron [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'info_cache' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26136383733313834', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136383733313834', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-748895696',display_name='tempest-ServerActionsTestOtherA-server-748895696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-748895696',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-e3ryz9gr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=b73970f1-764f-46ed-a25a-b5418a91b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:27:17 user nova-compute[74880]:   <uuid>b73970f1-764f-46ed-a25a-b5418a91b17b</uuid>
Nov 15 01:27:17 user nova-compute[74880]:   <name>instance-0000001e</name>
Nov 15 01:27:17 user nova-compute[74880]:   <memory>2097152</memory>
Nov 15 01:27:17 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:27:17 user nova-compute[74880]:   <metadata>
Nov 15 01:27:17 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:27:17 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:27:17 user nova-compute[74880]:       <nova:name>tempest-ServerActionsTestOtherA-server-748895696</nova:name>
Nov 15 01:27:17 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:27:16</nova:creationTime>
Nov 15 01:27:17 user nova-compute[74880]:       <nova:flavor name="m1.small">
Nov 15 01:27:17 user nova-compute[74880]:         <nova:memory>2048</nova:memory>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:disk>20</nova:disk>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:27:17 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:27:17 user nova-compute[74880]:       <nova:owner>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:user uuid="c0b04e9fd63942fb9279c26ddeec3acc">tempest-ServerActionsTestOtherA-1659960630-project-member</nova:user>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:project uuid="d3350f1780d5464dae7c3eca61375446">tempest-ServerActionsTestOtherA-1659960630</nova:project>
Nov 15 01:27:17 user nova-compute[74880]:       </nova:owner>
Nov 15 01:27:17 user nova-compute[74880]:       <nova:ports>
Nov 15 01:27:17 user nova-compute[74880]:         <nova:port uuid="64bd0957-7c1f-4660-b3ff-2445d6af85d6">
Nov 15 01:27:17 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:27:17 user nova-compute[74880]:         </nova:port>
Nov 15 01:27:17 user nova-compute[74880]:       </nova:ports>
Nov 15 01:27:17 user nova-compute[74880]:     </nova:instance>
Nov 15 01:27:17 user nova-compute[74880]:   </metadata>
Nov 15 01:27:17 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:27:17 user nova-compute[74880]:     <system>
Nov 15 01:27:17 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:27:17 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:27:17 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:27:17 user nova-compute[74880]:       <entry name="serial">b73970f1-764f-46ed-a25a-b5418a91b17b</entry>
Nov 15 01:27:17 user nova-compute[74880]:       <entry name="uuid">b73970f1-764f-46ed-a25a-b5418a91b17b</entry>
Nov 15 01:27:17 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:27:17 user nova-compute[74880]:     </system>
Nov 15 01:27:17 user nova-compute[74880]:   </sysinfo>
Nov 15 01:27:17 user nova-compute[74880]:   <os>
Nov 15 01:27:17 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:27:17 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:27:17 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:27:17 user nova-compute[74880]:   </os>
Nov 15 01:27:17 user nova-compute[74880]:   <features>
Nov 15 01:27:17 user nova-compute[74880]:     <acpi/>
Nov 15 01:27:17 user nova-compute[74880]:     <apic/>
Nov 15 01:27:17 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:27:17 user nova-compute[74880]:   </features>
Nov 15 01:27:17 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:27:17 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:27:17 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:27:17 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:27:17 user nova-compute[74880]:   </clock>
Nov 15 01:27:17 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:27:17 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:27:17 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:27:17 user nova-compute[74880]:   </cpu>
Nov 15 01:27:17 user nova-compute[74880]:   <devices>
Nov 15 01:27:17 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:27:17 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:27:17 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:27:17 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:27:17 user nova-compute[74880]:       <serial>7397a78f-439d-4d7e-8175-2518aef395ef</serial>
Nov 15 01:27:17 user nova-compute[74880]:     </disk>
Nov 15 01:27:17 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:27:17 user nova-compute[74880]:       <mac address="fa:16:3e:c8:3d:0a"/>
Nov 15 01:27:17 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:17 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:27:17 user nova-compute[74880]:       <target dev="tap64bd0957-7c"/>
Nov 15 01:27:17 user nova-compute[74880]:     </interface>
Nov 15 01:27:17 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:27:17 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/b73970f1-764f-46ed-a25a-b5418a91b17b/console.log" append="off"/>
Nov 15 01:27:17 user nova-compute[74880]:     </serial>
Nov 15 01:27:17 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:27:17 user nova-compute[74880]:     <video>
Nov 15 01:27:17 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:17 user nova-compute[74880]:     </video>
Nov 15 01:27:17 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:27:17 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:27:17 user nova-compute[74880]:     </rng>
Nov 15 01:27:17 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:27:17 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:27:17 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:27:17 user nova-compute[74880]:     </memballoon>
Nov 15 01:27:17 user nova-compute[74880]:   </devices>
Nov 15 01:27:17 user nova-compute[74880]: </domain>
Nov 15 01:27:17 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-748895696',display_name='tempest-ServerActionsTestOtherA-server-748895696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-748895696',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-e3ryz9gr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=b73970f1-764f-46ed-a25a-b5418a91b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2001162957-network", "vif_mac": "fa:16:3e:c8:3d:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG os_vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5792657b-2d3a-5512-8a4c-72f4841986dd', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64bd0957-7c, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64bd0957-7c, col_values=(('qos', UUID('ec6bf166-0aaa-4cc7-bc1f-521ed4319456')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64bd0957-7c, col_values=(('external_ids', {'iface-id': '64bd0957-7c1f-4660-b3ff-2445d6af85d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:3d:0a', 'vm-uuid': 'b73970f1-764f-46ed-a25a-b5418a91b17b'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:17 user nova-compute[74880]: INFO os_vif [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c')
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:27:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] No VIF found with MAC fa:16:3e:c8:3d:0a, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.network.neutron [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Releasing lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:18 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance destroyed successfully.
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'resources' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867c6194-56, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d738aadf-24cf-4679-8494-a5d56859f5a0) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:18 user nova-compute[74880]: INFO os_vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56')
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:27:18 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1898e78-bb6f-4b89-b4e5-1920c19bc761]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:27:18 user nova-compute[74880]: No targets found.
Nov 15 01:27:18 user nova-compute[74880]: iSNS:
Nov 15 01:27:18 user nova-compute[74880]: No targets found.
Nov 15 01:27:18 user nova-compute[74880]: STATIC:
Nov 15 01:27:18 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:27:18 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:18 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:18 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:27:18 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:18 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:18 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:27:18 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:18 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:18 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093
Nov 15 01:27:18 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:18 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:18 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:27:18 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:27:18 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:27:18 user nova-compute[74880]: FIRMWARE:
Nov 15 01:27:18 user nova-compute[74880]: No targets found.
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:27:18 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:27:18 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09fef86-e5c3-4946-9647-dd8cb2d02f71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4156999-0d98-434a-b19d-447a541d1a2f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06dd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd'): ({'sdg'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Removing single pathed devices sdg {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b5f61-f4d5-4767-80b6-03a238dd9e65]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac15e76-e115-4a6d-9b2e-99d3668b110b]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flushing IO for device /dev/sdg {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e008e7-65ca-47bd-937f-911e9bbd67e5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37028629-a5ea-461d-bc32-02ededfca250]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] SCSI volumes sdg have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e28c84d-fcf3-4e13-bc63-940038510f87]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[092eff91-bae6-428c-9140-de16d069ef3c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]
Nov 15 01:27:18 user nova-compute[74880]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1653a-ad30-4b63-953a-1ea51e60ae12]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== disconnect_volume: return (308ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start _get_guest_xml network_info=[{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '395fbdae-60fb-4d53-a8b5-731eb60a1c18', 'attached_at': '', 'detached_at': '', 'volume_id': 'babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'serial': 'babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd'}, 'mount_device': '/dev/vdb', 'attachment_id': 'a0638112-8564-4e58-bfb7-28db637f940e', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'numa_topology' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:18 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:18 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:27:18 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:18 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:27:18 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9acc21-b066-4e6d-9d21-7606274601ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:27:18 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e6cb8d-be42-429e-b567-35bb18308603]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd] added
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d69ba0-cc2c-4011-8d71-dd102b20731f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73b854-8b80-4d79-98b9-45eec5a4ae40]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYOSKZcL {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYOSKZcL" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da0ede0-0786-46b6-933d-25909e70789a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYOSKZcL'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[09525717-abf4-4ae0-93c0-e5cedf9bd561]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f56d3a0-a1fe-4103-b51e-4c63215f50c4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa673a-eff2-493f-b8e0-3fba9c7efdec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]
Nov 15 01:27:18 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8346dc-7169-45e0-aa26-ccadf03ddaa0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4cf80c-2916-4eae-aee6-bbde0f0390f4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:27:18 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:27:18 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da33a4-8d3e-47f9-a036-02e28098e623]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:27:18 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e2ab3d2-d98c-4406-a66e-2d0f8942d18e req-54b8f506-0947-4a18-af0a-6c68b74cba7c service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e2ab3d2-d98c-4406-a66e-2d0f8942d18e req-54b8f506-0947-4a18-af0a-6c68b74cba7c service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e2ab3d2-d98c-4406-a66e-2d0f8942d18e req-54b8f506-0947-4a18-af0a-6c68b74cba7c service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e2ab3d2-d98c-4406-a66e-2d0f8942d18e req-54b8f506-0947-4a18-af0a-6c68b74cba7c service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e2ab3d2-d98c-4406-a66e-2d0f8942d18e req-54b8f506-0947-4a18-af0a-6c68b74cba7c service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:19 user nova-compute[74880]: WARNING nova.compute.manager [req-4e2ab3d2-d98c-4406-a66e-2d0f8942d18e req-54b8f506-0947-4a18-af0a-6c68b74cba7c service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state active and task_state resize_finish.
Nov 15 01:27:19 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23061303233633862', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:27:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061303233633862', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'pci_devices' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:27:20 user nova-compute[74880]:   <uuid>395fbdae-60fb-4d53-a8b5-731eb60a1c18</uuid>
Nov 15 01:27:20 user nova-compute[74880]:   <name>instance-0000001b</name>
Nov 15 01:27:20 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:27:20 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:27:20 user nova-compute[74880]:   <metadata>
Nov 15 01:27:20 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:27:20 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:27:20 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeTestJSON-server-944524409</nova:name>
Nov 15 01:27:20 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:27:18</nova:creationTime>
Nov 15 01:27:20 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:27:20 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:27:20 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:27:20 user nova-compute[74880]:       <nova:owner>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:user uuid="66ea86fccfa749a6a52ac67af682af26">tempest-AttachVolumeTestJSON-1609488545-project-member</nova:user>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:project uuid="0ad971c8d358435095c37d13aac7a30c">tempest-AttachVolumeTestJSON-1609488545</nova:project>
Nov 15 01:27:20 user nova-compute[74880]:       </nova:owner>
Nov 15 01:27:20 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:27:20 user nova-compute[74880]:       <nova:ports>
Nov 15 01:27:20 user nova-compute[74880]:         <nova:port uuid="867c6194-568e-45ef-8222-558e115db573">
Nov 15 01:27:20 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:27:20 user nova-compute[74880]:         </nova:port>
Nov 15 01:27:20 user nova-compute[74880]:       </nova:ports>
Nov 15 01:27:20 user nova-compute[74880]:     </nova:instance>
Nov 15 01:27:20 user nova-compute[74880]:   </metadata>
Nov 15 01:27:20 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:27:20 user nova-compute[74880]:     <system>
Nov 15 01:27:20 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:27:20 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:27:20 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:27:20 user nova-compute[74880]:       <entry name="serial">395fbdae-60fb-4d53-a8b5-731eb60a1c18</entry>
Nov 15 01:27:20 user nova-compute[74880]:       <entry name="uuid">395fbdae-60fb-4d53-a8b5-731eb60a1c18</entry>
Nov 15 01:27:20 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:27:20 user nova-compute[74880]:     </system>
Nov 15 01:27:20 user nova-compute[74880]:   </sysinfo>
Nov 15 01:27:20 user nova-compute[74880]:   <os>
Nov 15 01:27:20 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:27:20 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:27:20 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:27:20 user nova-compute[74880]:   </os>
Nov 15 01:27:20 user nova-compute[74880]:   <features>
Nov 15 01:27:20 user nova-compute[74880]:     <acpi/>
Nov 15 01:27:20 user nova-compute[74880]:     <apic/>
Nov 15 01:27:20 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:27:20 user nova-compute[74880]:   </features>
Nov 15 01:27:20 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:27:20 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:27:20 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:27:20 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:27:20 user nova-compute[74880]:   </clock>
Nov 15 01:27:20 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:27:20 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:27:20 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:27:20 user nova-compute[74880]:   </cpu>
Nov 15 01:27:20 user nova-compute[74880]:   <devices>
Nov 15 01:27:20 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:27:20 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:27:20 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk"/>
Nov 15 01:27:20 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:27:20 user nova-compute[74880]:     </disk>
Nov 15 01:27:20 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:27:20 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:27:20 user nova-compute[74880]:       <source dev="/dev/sdf"/>
Nov 15 01:27:20 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:27:20 user nova-compute[74880]:       <serial>babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd</serial>
Nov 15 01:27:20 user nova-compute[74880]:     </disk>
Nov 15 01:27:20 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:27:20 user nova-compute[74880]:       <mac address="fa:16:3e:45:24:9c"/>
Nov 15 01:27:20 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:20 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:27:20 user nova-compute[74880]:       <target dev="tap867c6194-56"/>
Nov 15 01:27:20 user nova-compute[74880]:     </interface>
Nov 15 01:27:20 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:27:20 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/console.log" append="off"/>
Nov 15 01:27:20 user nova-compute[74880]:     </serial>
Nov 15 01:27:20 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:27:20 user nova-compute[74880]:     <video>
Nov 15 01:27:20 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:20 user nova-compute[74880]:     </video>
Nov 15 01:27:20 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:27:20 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:27:20 user nova-compute[74880]:     </rng>
Nov 15 01:27:20 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:27:20 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:27:20 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:27:20 user nova-compute[74880]:     </memballoon>
Nov 15 01:27:20 user nova-compute[74880]:   </devices>
Nov 15 01:27:20 user nova-compute[74880]: </domain>
Nov 15 01:27:20 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'trusted_certs' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Cannot resize image /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'migration_context' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.objects.base [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG os_vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f417a383-8e31-5e95-95c7-cb0ea81efca9', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867c6194-56, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867c6194-56, col_values=(('qos', UUID('26e8f352-972a-4b05-9d4a-a84b17bfd020')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867c6194-56, col_values=(('external_ids', {'iface-id': '867c6194-568e-45ef-8222-558e115db573', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:24:9c', 'vm-uuid': '395fbdae-60fb-4d53-a8b5-731eb60a1c18'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:20 user nova-compute[74880]: INFO os_vif [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56')
Nov 15 01:27:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-34ed07e5-839e-4e34-aecd-6beb990dffdf req-50cab3c3-a178-415d-b159-5a869ce27988 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-34ed07e5-839e-4e34-aecd-6beb990dffdf req-50cab3c3-a178-415d-b159-5a869ce27988 service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-34ed07e5-839e-4e34-aecd-6beb990dffdf req-50cab3c3-a178-415d-b159-5a869ce27988 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-34ed07e5-839e-4e34-aecd-6beb990dffdf req-50cab3c3-a178-415d-b159-5a869ce27988 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-34ed07e5-839e-4e34-aecd-6beb990dffdf req-50cab3c3-a178-415d-b159-5a869ce27988 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:21 user nova-compute[74880]: WARNING nova.compute.manager [req-34ed07e5-839e-4e34-aecd-6beb990dffdf req-50cab3c3-a178-415d-b159-5a869ce27988 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state active and task_state resize_finish.
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:27:22 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance running successfully.
Nov 15 01:27:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Failed to set time: agent not configured {{(pid=74880) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d3af1ab8-aa46-4f0f-8539-bf4419dcb88d tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] finish_migration finished successfully. {{(pid=74880) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-80306f53-4bdb-4db4-8389-d659b5b80e13 req-2e078937-fe81-4a24-abd0-d5d93848612b service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-80306f53-4bdb-4db4-8389-d659b5b80e13 req-2e078937-fe81-4a24-abd0-d5d93848612b service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-80306f53-4bdb-4db4-8389-d659b5b80e13 req-2e078937-fe81-4a24-abd0-d5d93848612b service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-80306f53-4bdb-4db4-8389-d659b5b80e13 req-2e078937-fe81-4a24-abd0-d5d93848612b service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-80306f53-4bdb-4db4-8389-d659b5b80e13 req-2e078937-fe81-4a24-abd0-d5d93848612b service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:22 user nova-compute[74880]: WARNING nova.compute.manager [req-80306f53-4bdb-4db4-8389-d659b5b80e13 req-2e078937-fe81-4a24-abd0-d5d93848612b service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state stopped and task_state powering-on.
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-f6b7f6ee-beb1-4960-9d65-59fdfd7f81aa req-2089012c-2db8-4c59-9718-d701891a4493 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f6b7f6ee-beb1-4960-9d65-59fdfd7f81aa req-2089012c-2db8-4c59-9718-d701891a4493 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f6b7f6ee-beb1-4960-9d65-59fdfd7f81aa req-2089012c-2db8-4c59-9718-d701891a4493 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f6b7f6ee-beb1-4960-9d65-59fdfd7f81aa req-2089012c-2db8-4c59-9718-d701891a4493 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-f6b7f6ee-beb1-4960-9d65-59fdfd7f81aa req-2089012c-2db8-4c59-9718-d701891a4493 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:24 user nova-compute[74880]: WARNING nova.compute.manager [req-f6b7f6ee-beb1-4960-9d65-59fdfd7f81aa req-2089012c-2db8-4c59-9718-d701891a4493 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state stopped and task_state powering-on.
Nov 15 01:27:24 user nova-compute[74880]: DEBUG nova.compute.manager [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:27:24 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance rebooted successfully.
Nov 15 01:27:24 user nova-compute[74880]: DEBUG nova.compute.manager [None req-73dc8627-2945-4f7b-8591-6512ce532878 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:27:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-changed-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Refreshing instance network info cache due to event network-changed-6c622032-85ad-4e3a-a024-a930e3231611. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] Acquiring lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] Acquired lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Refreshing network info cache for port 6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:28 user nova-compute[74880]: INFO nova.compute.manager [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Terminating instance
Nov 15 01:27:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-01f99ce8-5453-4414-8709-0389c77a636a req-d76f9c3d-0b82-4587-a682-f4210da08c79 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-unplugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-01f99ce8-5453-4414-8709-0389c77a636a req-d76f9c3d-0b82-4587-a682-f4210da08c79 service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-01f99ce8-5453-4414-8709-0389c77a636a req-d76f9c3d-0b82-4587-a682-f4210da08c79 service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-01f99ce8-5453-4414-8709-0389c77a636a req-d76f9c3d-0b82-4587-a682-f4210da08c79 service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-01f99ce8-5453-4414-8709-0389c77a636a req-d76f9c3d-0b82-4587-a682-f4210da08c79 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-unplugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-01f99ce8-5453-4414-8709-0389c77a636a req-d76f9c3d-0b82-4587-a682-f4210da08c79 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-unplugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updated VIF entry in instance network info cache for port 6c622032-85ad-4e3a-a024-a930e3231611. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updating instance_info_cache with network_info: [{"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c96dbed-332e-4252-9b6d-b17498fd54f5 req-d27d6d09-2fec-4742-8fbc-a76d0a27c6b4 service nova] Releasing lock "refresh_cache-97877ac2-ab65-413a-96a1-928847c8a0a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Instance destroyed successfully.
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'resources' on Instance uuid 97877ac2-ab65-413a-96a1-928847c8a0a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:24:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-966913070',display_name='tempest-TestStampPattern-server-966913070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-966913070',id=28,image_ref='d914e26f-c82b-484a-ad1d-7204ae80ecd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG95KHprtUgb5ymRCd6lTxiyqEUi8lMu7mCWG7VewMJuAVjD8xz4kDJVqxJmD8p0wXX5Qzb1MHKG7wVCeJwshyMqg3BWDFP+wfFDMHkCQaSz9lW4qeUs6021F3fVH4Cyyw==',key_name='tempest-TestStampPattern-1850115214',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='386aadc3b4fe4658b08779ebdb482b5f',ramdisk_id='',reservation_id='r-q3oynv29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ad07de27-3fd2-466c-a066-0b2883bf68a8',image_min_disk='1',image_min_ram='0',image_owner_id='386aadc3b4fe4658b08779ebdb482b5f',image_owner_project_name='tempest-TestStampPattern-1899706846',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1899706846-project-member',image_user_id='8269824ea172423b96ad3d29ff63ed2f',owner_project_name='tempest-TestStampPattern-1899706846',owner_user_name='tempest-TestStampPattern-1899706846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:24:42Z,user_data=None,user_id='8269824ea172423b96ad3d29ff63ed2f',uuid=97877ac2-ab65-413a-96a1-928847c8a0a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converting VIF {"id": "6c622032-85ad-4e3a-a024-a930e3231611", "address": "fa:16:3e:56:05:68", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c622032-85", "ovs_interfaceid": "6c622032-85ad-4e3a-a024-a930e3231611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG os_vif [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c622032-85, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bca51c23-a782-437f-8638-31f74d6be1f4) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:29 user nova-compute[74880]: INFO os_vif [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:05:68,bridge_name='br-int',has_traffic_filtering=True,id=6c622032-85ad-4e3a-a024-a930e3231611,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c622032-85')
Nov 15 01:27:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Deleting instance files /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8_del
Nov 15 01:27:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Deletion of /opt/stack/data/nova/instances/97877ac2-ab65-413a-96a1-928847c8a0a8_del complete
Nov 15 01:27:29 user nova-compute[74880]: INFO nova.compute.manager [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 01:27:29 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:27:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:30 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Took 0.60 seconds to deallocate network for instance.
Nov 15 01:27:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-c2929cf4-360b-4c28-b24a-7e41f4c63631 req-23007288-6772-4b4f-af63-e6698185c71d service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-deleted-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:27:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:30 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Deleted allocations for instance 97877ac2-ab65-413a-96a1-928847c8a0a8
Nov 15 01:27:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6574a6ce-6432-4f6f-a064-aa2e4dc66771 tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:31 user nova-compute[74880]: WARNING nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received unexpected event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with vm_state deleted and task_state None.
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:31 user nova-compute[74880]: WARNING nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received unexpected event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with vm_state deleted and task_state None.
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:31 user nova-compute[74880]: WARNING nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received unexpected event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with vm_state deleted and task_state None.
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Acquiring lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] Lock "97877ac2-ab65-413a-96a1-928847c8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] No waiting events found dispatching network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:31 user nova-compute[74880]: WARNING nova.compute.manager [req-13d98b6f-b0f8-4ee9-ad92-f802683bfd7c req-c6abed20-ade2-4c55-97f0-8bd5b95e0bdc service nova] [instance: 97877ac2-ab65-413a-96a1-928847c8a0a8] Received unexpected event network-vif-plugged-6c622032-85ad-4e3a-a024-a930e3231611 for instance with vm_state deleted and task_state None.
Nov 15 01:27:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:27:46 user nova-compute[74880]: INFO nova.compute.claims [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Claim successful on node user
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:27:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:27:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.policy [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dd436c8ece5405789f44db4c8349c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9537a43f73f472c9d8c90ed75d72e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:27:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Creating image(s)
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.168s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk 1073741824" returned: 0 in 0.052s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Successfully created port: 11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Cannot resize image /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Ensure instance console log exists: /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Successfully updated port: 11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquired lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-changed-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Refreshing instance network info cache due to event network-changed-11498cda-9b15-4829-80a6-c12044df9a93. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] Acquiring lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updating instance_info_cache with network_info: [{"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Releasing lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Instance network_info: |[{"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] Acquired lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Refreshing network info cache for port 11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Start _get_guest_xml network_info=[{"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:27:48 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:48 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:27:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-20456554',display_name='tempest-AttachVolumeNegativeTest-server-20456554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-20456554',id=34,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1D1cU+GVZ2Ei3n7UeWMEsMmL50cSUMus5HtgwfiFExovs92xnRSIXzaciksHx3dxuYFdXlBNf5IUpoDKJVvgI9b/ty0RfvDDhTxOVH40wWdwgtIm2EPLcAWgX/O+fmNg==',key_name='tempest-keypair-1854920452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-00uxcdf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:27:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=f4c1939c-4166-41e1-a915-af269583b53a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'pci_devices' on Instance uuid f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:27:48 user nova-compute[74880]:   <uuid>f4c1939c-4166-41e1-a915-af269583b53a</uuid>
Nov 15 01:27:48 user nova-compute[74880]:   <name>instance-00000022</name>
Nov 15 01:27:48 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:27:48 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:27:48 user nova-compute[74880]:   <metadata>
Nov 15 01:27:48 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:27:48 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:27:48 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeNegativeTest-server-20456554</nova:name>
Nov 15 01:27:48 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:27:48</nova:creationTime>
Nov 15 01:27:48 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:27:48 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:27:48 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:27:48 user nova-compute[74880]:       <nova:owner>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:user uuid="1dd436c8ece5405789f44db4c8349c97">tempest-AttachVolumeNegativeTest-1148149593-project-member</nova:user>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:project uuid="c9537a43f73f472c9d8c90ed75d72e2d">tempest-AttachVolumeNegativeTest-1148149593</nova:project>
Nov 15 01:27:48 user nova-compute[74880]:       </nova:owner>
Nov 15 01:27:48 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:27:48 user nova-compute[74880]:       <nova:ports>
Nov 15 01:27:48 user nova-compute[74880]:         <nova:port uuid="11498cda-9b15-4829-80a6-c12044df9a93">
Nov 15 01:27:48 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 01:27:48 user nova-compute[74880]:         </nova:port>
Nov 15 01:27:48 user nova-compute[74880]:       </nova:ports>
Nov 15 01:27:48 user nova-compute[74880]:     </nova:instance>
Nov 15 01:27:48 user nova-compute[74880]:   </metadata>
Nov 15 01:27:48 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:27:48 user nova-compute[74880]:     <system>
Nov 15 01:27:48 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:27:48 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:27:48 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:27:48 user nova-compute[74880]:       <entry name="serial">f4c1939c-4166-41e1-a915-af269583b53a</entry>
Nov 15 01:27:48 user nova-compute[74880]:       <entry name="uuid">f4c1939c-4166-41e1-a915-af269583b53a</entry>
Nov 15 01:27:48 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:27:48 user nova-compute[74880]:     </system>
Nov 15 01:27:48 user nova-compute[74880]:   </sysinfo>
Nov 15 01:27:48 user nova-compute[74880]:   <os>
Nov 15 01:27:48 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:27:48 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:27:48 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:27:48 user nova-compute[74880]:   </os>
Nov 15 01:27:48 user nova-compute[74880]:   <features>
Nov 15 01:27:48 user nova-compute[74880]:     <acpi/>
Nov 15 01:27:48 user nova-compute[74880]:     <apic/>
Nov 15 01:27:48 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:27:48 user nova-compute[74880]:   </features>
Nov 15 01:27:48 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:27:48 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:27:48 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:27:48 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:27:48 user nova-compute[74880]:   </clock>
Nov 15 01:27:48 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:27:48 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:27:48 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:27:48 user nova-compute[74880]:   </cpu>
Nov 15 01:27:48 user nova-compute[74880]:   <devices>
Nov 15 01:27:48 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:27:48 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:27:48 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk"/>
Nov 15 01:27:48 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:27:48 user nova-compute[74880]:     </disk>
Nov 15 01:27:48 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:27:48 user nova-compute[74880]:       <mac address="fa:16:3e:86:a1:b9"/>
Nov 15 01:27:48 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:48 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:27:48 user nova-compute[74880]:       <target dev="tap11498cda-9b"/>
Nov 15 01:27:48 user nova-compute[74880]:     </interface>
Nov 15 01:27:48 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:27:48 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/console.log" append="off"/>
Nov 15 01:27:48 user nova-compute[74880]:     </serial>
Nov 15 01:27:48 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:27:48 user nova-compute[74880]:     <video>
Nov 15 01:27:48 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:27:48 user nova-compute[74880]:     </video>
Nov 15 01:27:48 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:27:48 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:27:48 user nova-compute[74880]:     </rng>
Nov 15 01:27:48 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:27:48 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:27:48 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:27:48 user nova-compute[74880]:     </memballoon>
Nov 15 01:27:48 user nova-compute[74880]:   </devices>
Nov 15 01:27:48 user nova-compute[74880]: </domain>
Nov 15 01:27:48 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:27:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-20456554',display_name='tempest-AttachVolumeNegativeTest-server-20456554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-20456554',id=34,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1D1cU+GVZ2Ei3n7UeWMEsMmL50cSUMus5HtgwfiFExovs92xnRSIXzaciksHx3dxuYFdXlBNf5IUpoDKJVvgI9b/ty0RfvDDhTxOVH40wWdwgtIm2EPLcAWgX/O+fmNg==',key_name='tempest-keypair-1854920452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-00uxcdf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:27:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=f4c1939c-4166-41e1-a915-af269583b53a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG os_vif [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66921020-74f7-59b6-8257-f6a334a689cf', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11498cda-9b, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11498cda-9b, col_values=(('qos', UUID('62141849-222a-4da7-a36a-08890a598efa')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11498cda-9b, col_values=(('external_ids', {'iface-id': '11498cda-9b15-4829-80a6-c12044df9a93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:a1:b9', 'vm-uuid': 'f4c1939c-4166-41e1-a915-af269583b53a'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:48 user nova-compute[74880]: INFO os_vif [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b')
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:27:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:86:a1:b9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:27:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:27:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updated VIF entry in instance network info cache for port 11498cda-9b15-4829-80a6-c12044df9a93. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updating instance_info_cache with network_info: [{"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c97b7a30-8a70-4a50-b4e2-d31133ab9583 req-4c6e86f0-60e2-40bf-85d0-46915774fad1 service nova] Releasing lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-7045f685-8102-40d5-9aac-f84daec1479f req-74257df1-c154-41c8-919a-b5df4e3b3052 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7045f685-8102-40d5-9aac-f84daec1479f req-74257df1-c154-41c8-919a-b5df4e3b3052 service nova] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7045f685-8102-40d5-9aac-f84daec1479f req-74257df1-c154-41c8-919a-b5df4e3b3052 service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7045f685-8102-40d5-9aac-f84daec1479f req-74257df1-c154-41c8-919a-b5df4e3b3052 service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-7045f685-8102-40d5-9aac-f84daec1479f req-74257df1-c154-41c8-919a-b5df4e3b3052 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] No waiting events found dispatching network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:50 user nova-compute[74880]: WARNING nova.compute.manager [req-7045f685-8102-40d5-9aac-f84daec1479f req-74257df1-c154-41c8-919a-b5df4e3b3052 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received unexpected event network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 for instance with vm_state building and task_state spawning.
Nov 15 01:27:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:27:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Instance spawned successfully.
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing instance network info cache due to event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-e408f958-b09d-42fb-812e-b5d82f0c510e req-39bd6ace-3c09-4080-8c62-06bd1f84b3a2 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e408f958-b09d-42fb-812e-b5d82f0c510e req-39bd6ace-3c09-4080-8c62-06bd1f84b3a2 service nova] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e408f958-b09d-42fb-812e-b5d82f0c510e req-39bd6ace-3c09-4080-8c62-06bd1f84b3a2 service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e408f958-b09d-42fb-812e-b5d82f0c510e req-39bd6ace-3c09-4080-8c62-06bd1f84b3a2 service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-e408f958-b09d-42fb-812e-b5d82f0c510e req-39bd6ace-3c09-4080-8c62-06bd1f84b3a2 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] No waiting events found dispatching network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:52 user nova-compute[74880]: WARNING nova.compute.manager [req-e408f958-b09d-42fb-812e-b5d82f0c510e req-39bd6ace-3c09-4080-8c62-06bd1f84b3a2 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received unexpected event network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 for instance with vm_state building and task_state spawning.
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:52 user nova-compute[74880]: INFO nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:52 user nova-compute[74880]: INFO nova.compute.manager [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Took 6.33 seconds to build instance.
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ad71fddf-36c7-4512-ae48-4dd22ac27ed6 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.433s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:52 user nova-compute[74880]: INFO nova.compute.manager [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Detaching volume 7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updated VIF entry in instance network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG nova.network.neutron [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1d7e213e-e54c-4bd7-b113-a8d3309640a3 req-cc702f25-5ca8-4a8d-871e-09f404e59255 service nova] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:53 user nova-compute[74880]: INFO nova.virt.block_device [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Attempting to driver detach volume 7942fb0c-2985-4efe-9022-c8e6121b4687 from mountpoint /dev/vdb
Nov 15 01:27:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Attempting to detach device vdb from instance 88540810-db28-4f01-aa45-5cc4497214e6 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:27:53 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:27:53 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:27:53 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:27:53 user nova-compute[74880]:   <serial>7942fb0c-2985-4efe-9022-c8e6121b4687</serial>
Nov 15 01:27:53 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:27:53 user nova-compute[74880]: </disk>
Nov 15 01:27:53 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:27:53 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully detached device vdb from instance 88540810-db28-4f01-aa45-5cc4497214e6 from the persistent domain config.
Nov 15 01:27:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88540810-db28-4f01-aa45-5cc4497214e6 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:27:53 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:27:53 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:27:53 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:27:53 user nova-compute[74880]:   <serial>7942fb0c-2985-4efe-9022-c8e6121b4687</serial>
Nov 15 01:27:53 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:27:53 user nova-compute[74880]: </disk>
Nov 15 01:27:53 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing instance network info cache due to event network-changed-95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] Acquiring lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] Acquired lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Refreshing network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:27:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:27:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7347MB free_disk=25.275882720947266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Applying migration context for instance b73970f1-764f-46ed-a25a-b5418a91b17b as it has an incoming, in-progress migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7. Migration status is finished {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 01:27:55 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating resource usage from migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updated VIF entry in instance network info cache for port 95133b7d-cd2d-44f6-a750-7354144aaf36. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [{"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-62af49cf-0242-46e9-92fb-e7c4a67b9b24 req-9593006c-c377-48a4-9429-749427ca0028 service nova] Releasing lock "refresh_cache-88540810-db28-4f01-aa45-5cc4497214e6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ad07de27-3fd2-466c-a066-0b2883bf68a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 88540810-db28-4f01-aa45-5cc4497214e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f2414209-8acf-4587-b277-00e244fe6d2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance b73970f1-764f-46ed-a25a-b5418a91b17b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f4c1939c-4166-41e1-a915-af269583b53a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:27:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:27:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:57 user nova-compute[74880]: INFO nova.compute.manager [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Rescuing
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-99e251d1-8a22-4af1-8e3f-ff146e4ffdd4 req-00ad1d29-d87c-4214-9fc6-c46a494751a9 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-99e251d1-8a22-4af1-8e3f-ff146e4ffdd4 req-00ad1d29-d87c-4214-9fc6-c46a494751a9 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-99e251d1-8a22-4af1-8e3f-ff146e4ffdd4 req-00ad1d29-d87c-4214-9fc6-c46a494751a9 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-99e251d1-8a22-4af1-8e3f-ff146e4ffdd4 req-00ad1d29-d87c-4214-9fc6-c46a494751a9 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-99e251d1-8a22-4af1-8e3f-ff146e4ffdd4 req-00ad1d29-d87c-4214-9fc6-c46a494751a9 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:27:58 user nova-compute[74880]: WARNING nova.compute.manager [req-99e251d1-8a22-4af1-8e3f-ff146e4ffdd4 req-00ad1d29-d87c-4214-9fc6-c46a494751a9 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state active and task_state rescuing.
Nov 15 01:27:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance destroyed successfully.
Nov 15 01:27:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Attempting a stable device rescue
Nov 15 01:27:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74880) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:27:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Creating image(s)
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "a8d6848dcb6e056e8caf8503973a712bfe46cf77" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:27:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a8d6848dcb6e056e8caf8503973a712bfe46cf77" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:27:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:27:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:27:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:27:59 user nova-compute[74880]: DEBUG nova.virt.images [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] 144890a8-559d-4f2e-b208-9db81f8ffbb5 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:27:59 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:27:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.part /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-6ca2ca98-e71b-4554-9f56-2db39d07864a req-4c58e63b-6916-4fd1-aa91-de85a89c23d2 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6ca2ca98-e71b-4554-9f56-2db39d07864a req-4c58e63b-6916-4fd1-aa91-de85a89c23d2 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6ca2ca98-e71b-4554-9f56-2db39d07864a req-4c58e63b-6916-4fd1-aa91-de85a89c23d2 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6ca2ca98-e71b-4554-9f56-2db39d07864a req-4c58e63b-6916-4fd1-aa91-de85a89c23d2 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-6ca2ca98-e71b-4554-9f56-2db39d07864a req-4c58e63b-6916-4fd1-aa91-de85a89c23d2 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:00 user nova-compute[74880]: WARNING nova.compute.manager [req-6ca2ca98-e71b-4554-9f56-2db39d07864a req-4c58e63b-6916-4fd1-aa91-de85a89c23d2 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state active and task_state rescuing.
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.part /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.converted" returned: 0 in 0.484s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a8d6848dcb6e056e8caf8503973a712bfe46cf77" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.856s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "a8d6848dcb6e056e8caf8503973a712bfe46cf77" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a8d6848dcb6e056e8caf8503973a712bfe46cf77" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77 --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77,backing_fmt=raw /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77,backing_fmt=raw /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue" returned: 0 in 0.055s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a8d6848dcb6e056e8caf8503973a712bfe46cf77" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'migration_context' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<8bc89cdc-b0df-44cb-87fe-daefba1fea88> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Start _get_guest_xml network_info=[{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "vif_mac": "fa:16:3e:42:63:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '144890a8-559d-4f2e-b208-9db81f8ffbb5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8bc89cdc-b0df-44cb-87fe-daefba1fea88', 'attached_at': '', 'detached_at': '', 'volume_id': '8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'serial': '8aa16c6f-b074-4334-bc6c-277eae1ba23e'}, 'mount_device': '/dev/vda', 'attachment_id': '985dabb4-9b4f-4175-9e83-3d8db5e75ed9', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'resources' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<8bc89cdc-b0df-44cb-87fe-daefba1fea88> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'numa_topology' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<8bc89cdc-b0df-44cb-87fe-daefba1fea88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:28:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:28:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.objects.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<8bc89cdc-b0df-44cb-87fe-daefba1fea88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:28:00 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:28:00 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:28:00 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[22642df5-52cd-49d5-9e92-ff952db2c9bb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BYFdENzS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 01:28:00 user nova-compute[74880]: node.name = iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:28:00 user nova-compute[74880]: node.tpgt = -1
Nov 15 01:28:00 user nova-compute[74880]: node.startup = automatic
Nov 15 01:28:00 user nova-compute[74880]: node.leading_login = No
Nov 15 01:28:00 user nova-compute[74880]: iface.iscsi_ifacename = default
Nov 15 01:28:00 user nova-compute[74880]: iface.net_ifacename = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.ipaddress = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.prefix_len = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.hwaddress = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.transport_name = tcp
Nov 15 01:28:00 user nova-compute[74880]: iface.initiatorname = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.vlan_id = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.vlan_priority = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.vlan_state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.iface_num = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.mtu = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.port = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.bootproto = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.subnet_mask = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.gateway = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_alt_client_id = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_dns = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_learn_iqn = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_vendor_id_state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_vendor_id = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.dhcp_slp_da = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.fragmentation = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.gratuitous_arp = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.incoming_forwarding = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.tos_state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.tos = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.ttl = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.delayed_ack = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.tcp_nagle = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.tcp_wsf_state = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.tcp_wsf = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.tcp_timer_scale = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.tcp_timestamp = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.redirect = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.def_task_mgmt_timeout = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.header_digest = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.data_digest = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.immediate_data = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.initial_r2t = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.data_seq_inorder = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.data_pdu_inorder = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.erl = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.max_receive_data_len = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.first_burst_len = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.max_outstanding_r2t = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.max_burst_len = 0
Nov 15 01:28:00 user nova-compute[74880]: iface.chap_auth = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.bidi_chap = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.strict_login_compliance = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.discovery_auth = <empty>
Nov 15 01:28:00 user nova-compute[74880]: iface.discovery_logout = <empty>
Nov 15 01:28:00 user nova-compute[74880]: node.discovery_address = <empty>
Nov 15 01:28:00 user nova-compute[74880]: node.discovery_port = 0
Nov 15 01:28:00 user nova-compute[74880]: node.discovery_type = static
Nov 15 01:28:00 user nova-compute[74880]: node.session.initial_cmdsn = 0
Nov 15 01:28:00 user nova-compute[74880]: node.session.initial_login_retry_max = 8
Nov 15 01:28:00 user nova-compute[74880]: node.session.xmit_thread_priority = -20
Nov 15 01:28:00 user nova-compute[74880]: node.session.cmds_max = 128
Nov 15 01:28:00 user nova-compute[74880]: node.session.queue_depth = 32
Nov 15 01:28:00 user nova-compute[74880]: node.session.nr_sessions = 1
Nov 15 01:28:00 user nova-compute[74880]: node.session.auth.authmethod = CHAP
Nov 15 01:28:00 user nova-compute[74880]: node.session.auth.username = BYFdENzS
Nov 15 01:28:00 user nova-compute[74880]: node.session.auth.password = ***
Nov 15 01:28:00 user nova-compute[74880]: node.session.auth.username_in = <empty>
Nov 15 01:28:00 user nova-compute[74880]: node.session.auth.password_in = <empty>
Nov 15 01:28:00 user nova-compute[74880]: node.session.auth.chap_algs = MD5
Nov 15 01:28:00 user nova-compute[74880]: node.session.timeo.replacement_timeout = 120
Nov 15 01:28:00 user nova-compute[74880]: node.session.err_timeo.abort_timeout = 15
Nov 15 01:28:00 user nova-compute[74880]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 01:28:00 user nova-compute[74880]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 01:28:00 user nova-compute[74880]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.FastAbort = Yes
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.InitialR2T = No
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.ImmediateData = Yes
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.MaxConnections = 1
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 01:28:00 user nova-compute[74880]: node.session.iscsi.ERL = 0
Nov 15 01:28:00 user nova-compute[74880]: node.session.scan = manual
Nov 15 01:28:00 user nova-compute[74880]: node.session.reopen_max = 0
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].address = 172.16.0.220
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].port = 3260
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].startup = manual
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].tcp.window_size = 524288
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].tcp.type_of_service = 0
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].timeo.logout_timeout = 15
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].timeo.login_timeout = 15
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].timeo.auth_timeout = 45
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].iscsi.DataDigest = None
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].iscsi.IFMarker = No
Nov 15 01:28:00 user nova-compute[74880]: node.conn[0].iscsi.OFMarker = No
Nov 15 01:28:00 user nova-compute[74880]: # END RECORD
Nov 15 01:28:00 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1f48a-2068-4cce-ba0c-ccf41a818c65]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f50192-aa08-4ac9-ae32-b3f7fff98372]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYFdENzS {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYFdENzS" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c644ccc6-54b1-4c46-a7cc-4328cec9a242]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BYFdENzS'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b4b11e-c959-4776-b5b9-d38cc9a6340d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[17479e8a-044f-4c7e-8938-bf7f77714daa]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7 (non-flash)
Nov 15 01:28:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:01 user nova-compute[74880]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7 (non-flash)
Nov 15 01:28:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.191s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] HCTL ('33', '0', '0', 0) found on session 38 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb6e000-e609-4841-8948-8cf331eb197d]: (4, ('0 0 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching for a device in session 38 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.220s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== connect_volume: return (221ms) {'type': 'block', 'scsi_wwn': '23537323239366664', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537323239366664', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2136740006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2136740006',id=31,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:26:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-rs6swch3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:26:23Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=8bc89cdc-b0df-44cb-87fe-daefba1fea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "vif_mac": "fa:16:3e:42:63:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "vif_mac": "fa:16:3e:42:63:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.objects.base [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<8bc89cdc-b0df-44cb-87fe-daefba1fea88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:28:01 user nova-compute[74880]:   <uuid>8bc89cdc-b0df-44cb-87fe-daefba1fea88</uuid>
Nov 15 01:28:01 user nova-compute[74880]:   <name>instance-0000001f</name>
Nov 15 01:28:01 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:28:01 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:28:01 user nova-compute[74880]:   <metadata>
Nov 15 01:28:01 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:28:01 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:28:01 user nova-compute[74880]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2136740006</nova:name>
Nov 15 01:28:01 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:28:00</nova:creationTime>
Nov 15 01:28:01 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:28:01 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:28:01 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:28:01 user nova-compute[74880]:       <nova:owner>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:user uuid="d34159a5cea6426f8e4303dbf20a99af">tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member</nova:user>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:project uuid="069cac8f31694b1abcac7d3cfaac76ed">tempest-ServerBootFromVolumeStableRescueTest-330586401</nova:project>
Nov 15 01:28:01 user nova-compute[74880]:       </nova:owner>
Nov 15 01:28:01 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:28:01 user nova-compute[74880]:       <nova:ports>
Nov 15 01:28:01 user nova-compute[74880]:         <nova:port uuid="dccf1c4f-87ec-42b8-97d5-21d7dd01c98e">
Nov 15 01:28:01 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 01:28:01 user nova-compute[74880]:         </nova:port>
Nov 15 01:28:01 user nova-compute[74880]:       </nova:ports>
Nov 15 01:28:01 user nova-compute[74880]:     </nova:instance>
Nov 15 01:28:01 user nova-compute[74880]:   </metadata>
Nov 15 01:28:01 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:28:01 user nova-compute[74880]:     <system>
Nov 15 01:28:01 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:28:01 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:28:01 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:28:01 user nova-compute[74880]:       <entry name="serial">8bc89cdc-b0df-44cb-87fe-daefba1fea88</entry>
Nov 15 01:28:01 user nova-compute[74880]:       <entry name="uuid">8bc89cdc-b0df-44cb-87fe-daefba1fea88</entry>
Nov 15 01:28:01 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:28:01 user nova-compute[74880]:     </system>
Nov 15 01:28:01 user nova-compute[74880]:   </sysinfo>
Nov 15 01:28:01 user nova-compute[74880]:   <os>
Nov 15 01:28:01 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:28:01 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:28:01 user nova-compute[74880]:   </os>
Nov 15 01:28:01 user nova-compute[74880]:   <features>
Nov 15 01:28:01 user nova-compute[74880]:     <acpi/>
Nov 15 01:28:01 user nova-compute[74880]:     <apic/>
Nov 15 01:28:01 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:28:01 user nova-compute[74880]:   </features>
Nov 15 01:28:01 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:28:01 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:28:01 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:28:01 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:28:01 user nova-compute[74880]:   </clock>
Nov 15 01:28:01 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:28:01 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:28:01 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:28:01 user nova-compute[74880]:   </cpu>
Nov 15 01:28:01 user nova-compute[74880]:   <devices>
Nov 15 01:28:01 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:28:01 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:28:01 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:28:01 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:28:01 user nova-compute[74880]:       <serial>8aa16c6f-b074-4334-bc6c-277eae1ba23e</serial>
Nov 15 01:28:01 user nova-compute[74880]:     </disk>
Nov 15 01:28:01 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:28:01 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:28:01 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue"/>
Nov 15 01:28:01 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:28:01 user nova-compute[74880]:       <boot order="1"/>
Nov 15 01:28:01 user nova-compute[74880]:     </disk>
Nov 15 01:28:01 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:28:01 user nova-compute[74880]:       <mac address="fa:16:3e:42:63:13"/>
Nov 15 01:28:01 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:28:01 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:28:01 user nova-compute[74880]:       <target dev="tapdccf1c4f-87"/>
Nov 15 01:28:01 user nova-compute[74880]:     </interface>
Nov 15 01:28:01 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:28:01 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/console.log" append="off"/>
Nov 15 01:28:01 user nova-compute[74880]:     </serial>
Nov 15 01:28:01 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:28:01 user nova-compute[74880]:     <video>
Nov 15 01:28:01 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:28:01 user nova-compute[74880]:     </video>
Nov 15 01:28:01 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:28:01 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:28:01 user nova-compute[74880]:     </rng>
Nov 15 01:28:01 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:28:01 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:28:01 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:28:01 user nova-compute[74880]:     </memballoon>
Nov 15 01:28:01 user nova-compute[74880]:   </devices>
Nov 15 01:28:01 user nova-compute[74880]: </domain>
Nov 15 01:28:01 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:28:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance destroyed successfully.
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:28:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No VIF found with MAC fa:16:3e:42:63:13, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-006f1c02-88d6-46a7-8039-d672a269152e req-d8219f17-45c9-4332-8b03-8fa37114832c service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-006f1c02-88d6-46a7-8039-d672a269152e req-d8219f17-45c9-4332-8b03-8fa37114832c service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-006f1c02-88d6-46a7-8039-d672a269152e req-d8219f17-45c9-4332-8b03-8fa37114832c service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-006f1c02-88d6-46a7-8039-d672a269152e req-d8219f17-45c9-4332-8b03-8fa37114832c service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-006f1c02-88d6-46a7-8039-d672a269152e req-d8219f17-45c9-4332-8b03-8fa37114832c service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:02 user nova-compute[74880]: WARNING nova.compute.manager [req-006f1c02-88d6-46a7-8039-d672a269152e req-d8219f17-45c9-4332-8b03-8fa37114832c service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state active and task_state rescuing.
Nov 15 01:28:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-4d7ea531-79d2-449b-919d-962ae3772b14 req-ca834e53-1e80-4d1f-96c9-09cab9905b62 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4d7ea531-79d2-449b-919d-962ae3772b14 req-ca834e53-1e80-4d1f-96c9-09cab9905b62 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4d7ea531-79d2-449b-919d-962ae3772b14 req-ca834e53-1e80-4d1f-96c9-09cab9905b62 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4d7ea531-79d2-449b-919d-962ae3772b14 req-ca834e53-1e80-4d1f-96c9-09cab9905b62 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-4d7ea531-79d2-449b-919d-962ae3772b14 req-ca834e53-1e80-4d1f-96c9-09cab9905b62 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:04 user nova-compute[74880]: WARNING nova.compute.manager [req-4d7ea531-79d2-449b-919d-962ae3772b14 req-ca834e53-1e80-4d1f-96c9-09cab9905b62 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state active and task_state rescuing.
Nov 15 01:28:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7149f6ec-bada-457c-9cb6-539ce8b28c6a tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:28:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88540810-db28-4f01-aa45-5cc4497214e6 is timed out.
Nov 15 01:28:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully detached device vdb from instance 88540810-db28-4f01-aa45-5cc4497214e6 from the live domain config.
Nov 15 01:28:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PlZHeziN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:28:13 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.048s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5eff67-de0b-4f49-9b1d-6968b915f228]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:28:13 user nova-compute[74880]: No targets found.
Nov 15 01:28:13 user nova-compute[74880]: iSNS:
Nov 15 01:28:13 user nova-compute[74880]: No targets found.
Nov 15 01:28:13 user nova-compute[74880]: STATIC:
Nov 15 01:28:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7
Nov 15 01:28:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:28:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:28:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:28:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093
Nov 15 01:28:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687
Nov 15 01:28:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:13 user nova-compute[74880]: FIRMWARE:
Nov 15 01:28:13 user nova-compute[74880]: No targets found.
Nov 15 01:28:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:28:13 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:28:13 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[326c0973-327b-48b3-b588-23e2a79de144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9873d6a-c1ab-430b-bde6-b4a0bbdda46a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7 (non-flash)
Nov 15 01:28:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:13 user nova-compute[74880]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ebf3add-b3e3-42bb-8390-c7a3b825caa7 (non-flash)
Nov 15 01:28:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06dc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687'): ({'sde'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Removing single pathed devices sde {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[db068d83-b51d-4814-9eef-130a0cadcdb9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fada682-7fa7-4b3c-a651-612961a24c54]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Flushing IO for device /dev/sde {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2624a-3e59-4a47-ba9e-0907e1141575]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b67ace-1e5c-4bfe-99c5-45adb9c84ba3]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[059b6b03-209c-4ebc-afde-519968effd74]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a893a69-b860-43b2-a114-6a960e4947ad]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260]
Nov 15 01:28:13 user nova-compute[74880]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687, portal: 172.16.0.220,3260] successful.
Nov 15 01:28:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7942fb0c-2985-4efe-9022-c8e6121b4687 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f260ada5-eab1-45d4-994b-94e4ff562c14]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] <== disconnect_volume: return (425ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:28:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:28:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:14 user nova-compute[74880]: DEBUG nova.objects.instance [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'flavor' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-241d7808-4847-4654-ae73-41e291607326 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-changed-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Refreshing instance network info cache due to event network-changed-c8cc087a-3e14-4498-b978-4af7af884899. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] Acquiring lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] Acquired lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Refreshing network info cache for port c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:23 user nova-compute[74880]: INFO nova.compute.manager [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Terminating instance
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-f1ef1142-6930-4097-92a1-5c0995b8fc5e req-0833eb1f-6e22-47ba-80f5-958f6af24a6d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-vif-unplugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f1ef1142-6930-4097-92a1-5c0995b8fc5e req-0833eb1f-6e22-47ba-80f5-958f6af24a6d service nova] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f1ef1142-6930-4097-92a1-5c0995b8fc5e req-0833eb1f-6e22-47ba-80f5-958f6af24a6d service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f1ef1142-6930-4097-92a1-5c0995b8fc5e req-0833eb1f-6e22-47ba-80f5-958f6af24a6d service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-f1ef1142-6930-4097-92a1-5c0995b8fc5e req-0833eb1f-6e22-47ba-80f5-958f6af24a6d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] No waiting events found dispatching network-vif-unplugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-f1ef1142-6930-4097-92a1-5c0995b8fc5e req-0833eb1f-6e22-47ba-80f5-958f6af24a6d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-vif-unplugged-c8cc087a-3e14-4498-b978-4af7af884899 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updated VIF entry in instance network info cache for port c8cc087a-3e14-4498-b978-4af7af884899. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updating instance_info_cache with network_info: [{"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5691f46e-cc82-446a-b9ac-1e19c02b1343 req-2e327e09-6ea5-4522-b0b5-f78bc87e6c1d service nova] Releasing lock "refresh_cache-ad07de27-3fd2-466c-a066-0b2883bf68a8" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:28:24 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Instance destroyed successfully.
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lazy-loading 'resources' on Instance uuid ad07de27-3fd2-466c-a066-0b2883bf68a8 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1339519285',display_name='tempest-TestStampPattern-server-1339519285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1339519285',id=22,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG95KHprtUgb5ymRCd6lTxiyqEUi8lMu7mCWG7VewMJuAVjD8xz4kDJVqxJmD8p0wXX5Qzb1MHKG7wVCeJwshyMqg3BWDFP+wfFDMHkCQaSz9lW4qeUs6021F3fVH4Cyyw==',key_name='tempest-TestStampPattern-1850115214',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:21:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='386aadc3b4fe4658b08779ebdb482b5f',ramdisk_id='',reservation_id='r-whsaqp4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1899706846',owner_user_name='tempest-TestStampPattern-1899706846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:24:33Z,user_data=None,user_id='8269824ea172423b96ad3d29ff63ed2f',uuid=ad07de27-3fd2-466c-a066-0b2883bf68a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converting VIF {"id": "c8cc087a-3e14-4498-b978-4af7af884899", "address": "fa:16:3e:5c:16:be", "network": {"id": "9c758fae-a2e4-450c-8149-4a8b2440e95f", "bridge": "br-int", "label": "tempest-TestStampPattern-624160911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386aadc3b4fe4658b08779ebdb482b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8cc087a-3e", "ovs_interfaceid": "c8cc087a-3e14-4498-b978-4af7af884899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG os_vif [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8cc087a-3e, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d943b23-f707-4a09-9df9-c3825d0be667) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:28:24 user nova-compute[74880]: INFO os_vif [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:be,bridge_name='br-int',has_traffic_filtering=True,id=c8cc087a-3e14-4498-b978-4af7af884899,network=Network(9c758fae-a2e4-450c-8149-4a8b2440e95f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8cc087a-3e')
Nov 15 01:28:24 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Deleting instance files /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8_del
Nov 15 01:28:24 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Deletion of /opt/stack/data/nova/instances/ad07de27-3fd2-466c-a066-0b2883bf68a8_del complete
Nov 15 01:28:24 user nova-compute[74880]: INFO nova.compute.manager [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 01:28:24 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:28:24 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:24 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Took 0.42 seconds to deallocate network for instance.
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:25 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Deleted allocations for instance ad07de27-3fd2-466c-a066-0b2883bf68a8
Nov 15 01:28:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-b469ee72-12c6-4954-b5c6-d5cd6bf74bf8 req-cb2180ae-1a67-4f46-9ff7-3b2961721475 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-vif-deleted-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a2a80386-fafa-42aa-9df1-ce32f6f1338b tempest-TestStampPattern-1899706846 tempest-TestStampPattern-1899706846-project-member] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-5b0f2c4d-20db-4395-ae84-5ab4af758b96 req-fab79e5c-4d8f-4ada-967a-15ba0ae8b729 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received event network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b0f2c4d-20db-4395-ae84-5ab4af758b96 req-fab79e5c-4d8f-4ada-967a-15ba0ae8b729 service nova] Acquiring lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b0f2c4d-20db-4395-ae84-5ab4af758b96 req-fab79e5c-4d8f-4ada-967a-15ba0ae8b729 service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b0f2c4d-20db-4395-ae84-5ab4af758b96 req-fab79e5c-4d8f-4ada-967a-15ba0ae8b729 service nova] Lock "ad07de27-3fd2-466c-a066-0b2883bf68a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-5b0f2c4d-20db-4395-ae84-5ab4af758b96 req-fab79e5c-4d8f-4ada-967a-15ba0ae8b729 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] No waiting events found dispatching network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:25 user nova-compute[74880]: WARNING nova.compute.manager [req-5b0f2c4d-20db-4395-ae84-5ab4af758b96 req-fab79e5c-4d8f-4ada-967a-15ba0ae8b729 service nova] [instance: ad07de27-3fd2-466c-a066-0b2883bf68a8] Received unexpected event network-vif-plugged-c8cc087a-3e14-4498-b978-4af7af884899 for instance with vm_state deleted and task_state None.
Nov 15 01:28:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:28:32 user nova-compute[74880]: INFO nova.compute.claims [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Claim successful on node user
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:28:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:28:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Creating image(s)
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "/opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "/opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "/opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG nova.policy [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6c1330cee67401fa675438a80aeb093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296ba5e9134ebf868a14e5d7551171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk 1073741824" returned: 0 in 0.056s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Cannot resize image /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Ensure instance console log exists: /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Successfully created port: 92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Successfully updated port: 92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "refresh_cache-47f989a2-c540-4e5c-8467-fa3a0078584e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquired lock "refresh_cache-47f989a2-c540-4e5c-8467-fa3a0078584e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-changed-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Refreshing instance network info cache due to event network-changed-92c15e41-890c-4f6b-9a84-03c880c55f1d. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] Acquiring lock "refresh_cache-47f989a2-c540-4e5c-8467-fa3a0078584e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Updating instance_info_cache with network_info: [{"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Releasing lock "refresh_cache-47f989a2-c540-4e5c-8467-fa3a0078584e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Instance network_info: |[{"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] Acquired lock "refresh_cache-47f989a2-c540-4e5c-8467-fa3a0078584e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.neutron [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Refreshing network info cache for port 92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Start _get_guest_xml network_info=[{"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:28:34 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:28:34 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1367521512',display_name='tempest-VolumesNegativeTest-instance-1367521512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1367521512',id=35,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da296ba5e9134ebf868a14e5d7551171',ramdisk_id='',reservation_id='r-u8yzo0ut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-640510573',owner_user_name='tempest-VolumesNegativeTest-640510573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:28:33Z,user_data=None,user_id='e6c1330cee67401fa675438a80aeb093',uuid=47f989a2-c540-4e5c-8467-fa3a0078584e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Converting VIF {"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lazy-loading 'pci_devices' on Instance uuid 47f989a2-c540-4e5c-8467-fa3a0078584e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:28:34 user nova-compute[74880]:   <uuid>47f989a2-c540-4e5c-8467-fa3a0078584e</uuid>
Nov 15 01:28:34 user nova-compute[74880]:   <name>instance-00000023</name>
Nov 15 01:28:34 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:28:34 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:28:34 user nova-compute[74880]:   <metadata>
Nov 15 01:28:34 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:28:34 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:28:34 user nova-compute[74880]:       <nova:name>tempest-VolumesNegativeTest-instance-1367521512</nova:name>
Nov 15 01:28:34 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:28:34</nova:creationTime>
Nov 15 01:28:34 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:28:34 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:28:34 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:28:34 user nova-compute[74880]:       <nova:owner>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:user uuid="e6c1330cee67401fa675438a80aeb093">tempest-VolumesNegativeTest-640510573-project-member</nova:user>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:project uuid="da296ba5e9134ebf868a14e5d7551171">tempest-VolumesNegativeTest-640510573</nova:project>
Nov 15 01:28:34 user nova-compute[74880]:       </nova:owner>
Nov 15 01:28:34 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:28:34 user nova-compute[74880]:       <nova:ports>
Nov 15 01:28:34 user nova-compute[74880]:         <nova:port uuid="92c15e41-890c-4f6b-9a84-03c880c55f1d">
Nov 15 01:28:34 user nova-compute[74880]:           <nova:ip type="fixed" address="192.168.233.198" ipVersion="4"/>
Nov 15 01:28:34 user nova-compute[74880]:         </nova:port>
Nov 15 01:28:34 user nova-compute[74880]:       </nova:ports>
Nov 15 01:28:34 user nova-compute[74880]:     </nova:instance>
Nov 15 01:28:34 user nova-compute[74880]:   </metadata>
Nov 15 01:28:34 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:28:34 user nova-compute[74880]:     <system>
Nov 15 01:28:34 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:28:34 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:28:34 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:28:34 user nova-compute[74880]:       <entry name="serial">47f989a2-c540-4e5c-8467-fa3a0078584e</entry>
Nov 15 01:28:34 user nova-compute[74880]:       <entry name="uuid">47f989a2-c540-4e5c-8467-fa3a0078584e</entry>
Nov 15 01:28:34 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:28:34 user nova-compute[74880]:     </system>
Nov 15 01:28:34 user nova-compute[74880]:   </sysinfo>
Nov 15 01:28:34 user nova-compute[74880]:   <os>
Nov 15 01:28:34 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:28:34 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:28:34 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:28:34 user nova-compute[74880]:   </os>
Nov 15 01:28:34 user nova-compute[74880]:   <features>
Nov 15 01:28:34 user nova-compute[74880]:     <acpi/>
Nov 15 01:28:34 user nova-compute[74880]:     <apic/>
Nov 15 01:28:34 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:28:34 user nova-compute[74880]:   </features>
Nov 15 01:28:34 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:28:34 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:28:34 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:28:34 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:28:34 user nova-compute[74880]:   </clock>
Nov 15 01:28:34 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:28:34 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:28:34 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:28:34 user nova-compute[74880]:   </cpu>
Nov 15 01:28:34 user nova-compute[74880]:   <devices>
Nov 15 01:28:34 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:28:34 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:28:34 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk"/>
Nov 15 01:28:34 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:28:34 user nova-compute[74880]:     </disk>
Nov 15 01:28:34 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:28:34 user nova-compute[74880]:       <mac address="fa:16:3e:e5:4b:47"/>
Nov 15 01:28:34 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:28:34 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:28:34 user nova-compute[74880]:       <target dev="tap92c15e41-89"/>
Nov 15 01:28:34 user nova-compute[74880]:     </interface>
Nov 15 01:28:34 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:28:34 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/console.log" append="off"/>
Nov 15 01:28:34 user nova-compute[74880]:     </serial>
Nov 15 01:28:34 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:28:34 user nova-compute[74880]:     <video>
Nov 15 01:28:34 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:28:34 user nova-compute[74880]:     </video>
Nov 15 01:28:34 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:28:34 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:28:34 user nova-compute[74880]:     </rng>
Nov 15 01:28:34 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:28:34 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:28:34 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:28:34 user nova-compute[74880]:     </memballoon>
Nov 15 01:28:34 user nova-compute[74880]:   </devices>
Nov 15 01:28:34 user nova-compute[74880]: </domain>
Nov 15 01:28:34 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1367521512',display_name='tempest-VolumesNegativeTest-instance-1367521512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1367521512',id=35,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da296ba5e9134ebf868a14e5d7551171',ramdisk_id='',reservation_id='r-u8yzo0ut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-640510573',owner_user_name='tempest-VolumesNegativeTest-640510573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:28:33Z,user_data=None,user_id='e6c1330cee67401fa675438a80aeb093',uuid=47f989a2-c540-4e5c-8467-fa3a0078584e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Converting VIF {"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG os_vif [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb326e57-f780-5931-8ff7-c2c07cb6792f', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92c15e41-89, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92c15e41-89, col_values=(('qos', UUID('ecdbb3fb-d701-4d9e-b346-1d5c872f4291')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92c15e41-89, col_values=(('external_ids', {'iface-id': '92c15e41-890c-4f6b-9a84-03c880c55f1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:4b:47', 'vm-uuid': '47f989a2-c540-4e5c-8467-fa3a0078584e'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:34 user nova-compute[74880]: INFO os_vif [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89')
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:28:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] No VIF found with MAC fa:16:3e:e5:4b:47, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:28:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Updated VIF entry in instance network info cache for port 92c15e41-890c-4f6b-9a84-03c880c55f1d. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:28:35 user nova-compute[74880]: DEBUG nova.network.neutron [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Updating instance_info_cache with network_info: [{"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-34838042-2b0d-4292-8920-aad96a3a2d18 req-3a74d99d-653b-4c11-88f1-9ac92e95f42a service nova] Releasing lock "refresh_cache-47f989a2-c540-4e5c-8467-fa3a0078584e" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-b02f581c-b7fe-4cf1-a02c-6952739669e1 req-c9184879-21ce-46d5-b1a7-be429d13f8ae service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b02f581c-b7fe-4cf1-a02c-6952739669e1 req-c9184879-21ce-46d5-b1a7-be429d13f8ae service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b02f581c-b7fe-4cf1-a02c-6952739669e1 req-c9184879-21ce-46d5-b1a7-be429d13f8ae service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b02f581c-b7fe-4cf1-a02c-6952739669e1 req-c9184879-21ce-46d5-b1a7-be429d13f8ae service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-b02f581c-b7fe-4cf1-a02c-6952739669e1 req-c9184879-21ce-46d5-b1a7-be429d13f8ae service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:36 user nova-compute[74880]: WARNING nova.compute.manager [req-b02f581c-b7fe-4cf1-a02c-6952739669e1 req-c9184879-21ce-46d5-b1a7-be429d13f8ae service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state building and task_state spawning.
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:28:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Instance spawned successfully.
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:28:38 user nova-compute[74880]: INFO nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:28:38 user nova-compute[74880]: INFO nova.compute.manager [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Took 6.33 seconds to build instance.
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ee7c524f-f18d-486e-a23e-10252e14b9dd tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.422s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-fa4c3fb0-94f3-403f-b41b-facb1a1d0e60 req-3a65f9c4-6ada-459e-b480-2fea668c53f0 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fa4c3fb0-94f3-403f-b41b-facb1a1d0e60 req-3a65f9c4-6ada-459e-b480-2fea668c53f0 service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fa4c3fb0-94f3-403f-b41b-facb1a1d0e60 req-3a65f9c4-6ada-459e-b480-2fea668c53f0 service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fa4c3fb0-94f3-403f-b41b-facb1a1d0e60 req-3a65f9c4-6ada-459e-b480-2fea668c53f0 service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-fa4c3fb0-94f3-403f-b41b-facb1a1d0e60 req-3a65f9c4-6ada-459e-b480-2fea668c53f0 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:38 user nova-compute[74880]: WARNING nova.compute.manager [req-fa4c3fb0-94f3-403f-b41b-facb1a1d0e60 req-3a65f9c4-6ada-459e-b480-2fea668c53f0 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state active and task_state None.
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "f2414209-8acf-4587-b277-00e244fe6d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:38 user nova-compute[74880]: INFO nova.compute.manager [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Terminating instance
Nov 15 01:28:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Instance destroyed successfully.
Nov 15 01:28:39 user nova-compute[74880]: DEBUG nova.objects.instance [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'resources' on Instance uuid f2414209-8acf-4587-b277-00e244fe6d2f {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1606982935',display_name='tempest-TestVolumeBootPattern-server-1606982935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1606982935',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-wffixqmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:27:06Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=f2414209-8acf-4587-b277-00e244fe6d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "address": "fa:16:3e:cf:35:32", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59b1558-c1", "ovs_interfaceid": "f59b1558-c1e6-40df-9781-5e12c24dedcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_vif [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf59b1558-c1, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=503faa4f-cb22-4681-bafe-37b7cadbe17b) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:39 user nova-compute[74880]: INFO os_vif [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:35:32,bridge_name='br-int',has_traffic_filtering=True,id=f59b1558-c1e6-40df-9781-5e12c24dedcc,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59b1558-c1')
Nov 15 01:28:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhwNDyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:28:39 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1affdc-655f-425c-a58c-2e3e9f4a805f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:28:39 user nova-compute[74880]: No targets found.
Nov 15 01:28:39 user nova-compute[74880]: iSNS:
Nov 15 01:28:39 user nova-compute[74880]: No targets found.
Nov 15 01:28:39 user nova-compute[74880]: STATIC:
Nov 15 01:28:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:28:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:28:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:28:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093
Nov 15 01:28:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:28:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:28:39 user nova-compute[74880]: FIRMWARE:
Nov 15 01:28:39 user nova-compute[74880]: No targets found.
Nov 15 01:28:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:28:39 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:28:39 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4e2abc-c7c3-4b59-a999-8aa6b30e13b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee166af-c0a3-4515-95f1-879f602abaa8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:39 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:28:39 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:39 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:39 user nova-compute[74880]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 (non-flash)
Nov 15 01:28:39 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:39 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9508189e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575c138-10da-4ddd-b0b0-bf5a0678f71f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abd2b48-a0f3-4271-89f6-d4443c0d2146]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[490fbd61-b725-4b04-a9c3-6b9e56914f4d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f00e82b-df21-4f98-8ed7-b1400552a249]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:28:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca526ba-749b-4931-8b4a-fb5263ca692e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b62d85-0591-4748-b823-eaebe2a43e3e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260]
Nov 15 01:28:40 user nova-compute[74880]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093, portal: 172.16.0.220,3260] successful.
Nov 15 01:28:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687dea9-b816-4785-910b-471e357fb093 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[856fc998-938a-4a82-aec0-4f7f8cfd38a5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== disconnect_volume: return (318ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:28:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Deleting instance files /opt/stack/data/nova/instances/f2414209-8acf-4587-b277-00e244fe6d2f_del
Nov 15 01:28:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Deletion of /opt/stack/data/nova/instances/f2414209-8acf-4587-b277-00e244fe6d2f_del complete
Nov 15 01:28:40 user nova-compute[74880]: INFO nova.compute.manager [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:40 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Took 0.48 seconds to deallocate network for instance.
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-76cf0197-4055-42f4-ac05-0f9c71925377 req-3be86779-d771-4c3c-8f0b-e6927c7dc015 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-vif-deleted-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:40 user nova-compute[74880]: INFO nova.compute.manager [req-76cf0197-4055-42f4-ac05-0f9c71925377 req-3be86779-d771-4c3c-8f0b-e6927c7dc015 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Neutron deleted interface f59b1558-c1e6-40df-9781-5e12c24dedcc; detaching it from the instance and deleting it from the info cache
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-76cf0197-4055-42f4-ac05-0f9c71925377 req-3be86779-d771-4c3c-8f0b-e6927c7dc015 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-vif-unplugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] No waiting events found dispatching network-vif-unplugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-vif-unplugged-f59b1558-c1e6-40df-9781-5e12c24dedcc for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received event network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] Acquiring lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] Lock "f2414209-8acf-4587-b277-00e244fe6d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] No waiting events found dispatching network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:40 user nova-compute[74880]: WARNING nova.compute.manager [req-9dd68bf5-6a30-4d8b-b091-b5fa3ed73271 req-dac9643d-21d3-4455-bef6-304ee251f774 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Received unexpected event network-vif-plugged-f59b1558-c1e6-40df-9781-5e12c24dedcc for instance with vm_state active and task_state deleting.
Nov 15 01:28:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-76cf0197-4055-42f4-ac05-0f9c71925377 req-3be86779-d771-4c3c-8f0b-e6927c7dc015 service nova] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Detach interface failed, port_id=f59b1558-c1e6-40df-9781-5e12c24dedcc, reason: Instance f2414209-8acf-4587-b277-00e244fe6d2f could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:28:41 user nova-compute[74880]: INFO nova.compute.manager [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Took 0.82 seconds to detach 1 volumes for instance.
Nov 15 01:28:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: f2414209-8acf-4587-b277-00e244fe6d2f] Deleting volume: 6687dea9-b816-4785-910b-471e357fb093 {{(pid=74880) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 01:28:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:41 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:28:41 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:28:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:42 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Deleted allocations for instance f2414209-8acf-4587-b277-00e244fe6d2f
Nov 15 01:28:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-485e08e5-f03e-4c0f-8506-95bbf991db38 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "f2414209-8acf-4587-b277-00e244fe6d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:43 user nova-compute[74880]: INFO nova.compute.manager [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Terminating instance
Nov 15 01:28:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-a6f916ec-0a70-403d-9043-8fba3efd1853 req-49567e85-e00d-4b62-a437-7bd461a5d893 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a6f916ec-0a70-403d-9043-8fba3efd1853 req-49567e85-e00d-4b62-a437-7bd461a5d893 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a6f916ec-0a70-403d-9043-8fba3efd1853 req-49567e85-e00d-4b62-a437-7bd461a5d893 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a6f916ec-0a70-403d-9043-8fba3efd1853 req-49567e85-e00d-4b62-a437-7bd461a5d893 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-a6f916ec-0a70-403d-9043-8fba3efd1853 req-49567e85-e00d-4b62-a437-7bd461a5d893 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-a6f916ec-0a70-403d-9043-8fba3efd1853 req-49567e85-e00d-4b62-a437-7bd461a5d893 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-unplugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Instance destroyed successfully.
Nov 15 01:28:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'resources' on Instance uuid 88540810-db28-4f01-aa45-5cc4497214e6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-444318931',display_name='tempest-ServerRescueNegativeTestJSON-server-444318931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-444318931',id=23,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8cAWldZA1oB9vFJmCXGl0c7Uog634wYXXB0/A8E9fmUE/jAvmYLSlo332qSqd2uSixKAYRepST8Ao+tynwuFe57rqk/0veuEXTnZz3p7CcgjAxs74+8a/znxsLx1WpPA==',key_name='tempest-keypair-1514010484',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-30yyp7wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=88540810-db28-4f01-aa45-5cc4497214e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "95133b7d-cd2d-44f6-a750-7354144aaf36", "address": "fa:16:3e:4a:23:14", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95133b7d-cd", "ovs_interfaceid": "95133b7d-cd2d-44f6-a750-7354144aaf36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG os_vif [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95133b7d-cd, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f161cae6-04a2-47c0-ab4f-38b29412b878) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:44 user nova-compute[74880]: INFO os_vif [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:14,bridge_name='br-int',has_traffic_filtering=True,id=95133b7d-cd2d-44f6-a750-7354144aaf36,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95133b7d-cd')
Nov 15 01:28:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Deleting instance files /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6_del
Nov 15 01:28:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Deletion of /opt/stack/data/nova/instances/88540810-db28-4f01-aa45-5cc4497214e6_del complete
Nov 15 01:28:44 user nova-compute[74880]: INFO nova.compute.manager [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 01:28:44 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:28:44 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:45 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Took 1.03 seconds to deallocate network for instance.
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-da72a3d8-7c55-4364-bf55-ca7082963cbc req-35ad11a4-219a-44d3-8a99-0168a5f38337 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-deleted-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:45 user nova-compute[74880]: INFO nova.compute.manager [req-da72a3d8-7c55-4364-bf55-ca7082963cbc req-35ad11a4-219a-44d3-8a99-0168a5f38337 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Neutron deleted interface 95133b7d-cd2d-44f6-a750-7354144aaf36; detaching it from the instance and deleting it from the info cache
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-da72a3d8-7c55-4364-bf55-ca7082963cbc req-35ad11a4-219a-44d3-8a99-0168a5f38337 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-da72a3d8-7c55-4364-bf55-ca7082963cbc req-35ad11a4-219a-44d3-8a99-0168a5f38337 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Detach interface failed, port_id=95133b7d-cd2d-44f6-a750-7354144aaf36, reason: Instance 88540810-db28-4f01-aa45-5cc4497214e6 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:45 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Deleted allocations for instance 88540810-db28-4f01-aa45-5cc4497214e6
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b28315b-c7c3-45df-a706-315cbeafd59f tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "88540810-db28-4f01-aa45-5cc4497214e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-5b2136e8-9771-4404-b9cd-f4235a674598 req-51c92d74-67dd-4fad-8bff-7f51d31eaac8 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b2136e8-9771-4404-b9cd-f4235a674598 req-51c92d74-67dd-4fad-8bff-7f51d31eaac8 service nova] Acquiring lock "88540810-db28-4f01-aa45-5cc4497214e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b2136e8-9771-4404-b9cd-f4235a674598 req-51c92d74-67dd-4fad-8bff-7f51d31eaac8 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5b2136e8-9771-4404-b9cd-f4235a674598 req-51c92d74-67dd-4fad-8bff-7f51d31eaac8 service nova] Lock "88540810-db28-4f01-aa45-5cc4497214e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-5b2136e8-9771-4404-b9cd-f4235a674598 req-51c92d74-67dd-4fad-8bff-7f51d31eaac8 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] No waiting events found dispatching network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:28:45 user nova-compute[74880]: WARNING nova.compute.manager [req-5b2136e8-9771-4404-b9cd-f4235a674598 req-51c92d74-67dd-4fad-8bff-7f51d31eaac8 service nova] [instance: 88540810-db28-4f01-aa45-5cc4497214e6] Received unexpected event network-vif-plugged-95133b7d-cd2d-44f6-a750-7354144aaf36 for instance with vm_state deleted and task_state None.
Nov 15 01:28:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-changed-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:28:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Refreshing instance network info cache due to event network-changed-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:28:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] Acquiring lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:28:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] Acquired lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:28:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Refreshing network info cache for port 90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updated VIF entry in instance network info cache for port 90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG nova.network.neutron [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating instance_info_cache with network_info: [{"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4ff4fbcf-df41-4842-afdd-a9ae3a28e73e req-23a905c2-4e40-4d1a-beff-47d33b42f818 service nova] Releasing lock "refresh_cache-11ebe5fe-f476-4a7b-ace2-b62e377c5b84" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:28:48 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue --force-share --output=json" returned: 0 in 0.367s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:50 user nova-compute[74880]: INFO nova.compute.manager [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attaching volume 2923a934-8d73-4228-a116-da5722b0b36c to /dev/vdb
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG os_brick.utils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec13e6b-6e85-4429-a5e0-8d5be137d7cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5276f152-d60c-4e32-afc2-8783520dac04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[594accba-1555-4774-b477-028f81ce26d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ba2f6-1061-412d-8792-17ae1f98ea68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:28:50 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dcc0ee-fd5b-42d0-bd99-1f9bb299a28d]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG os_brick.utils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating existing volume attachment record: be7427b5-68ec-43b2-b753-ce01ff1b7b24 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:28:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:28:53 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7294MB free_disk=25.30072784423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Applying migration context for instance b73970f1-764f-46ed-a25a-b5418a91b17b as it has an incoming, in-progress migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7. Migration status is finished {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 01:28:53 user nova-compute[74880]: INFO nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating resource usage from migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance fc9fe17c-b782-44d0-8adc-3c42fde5af94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance b73970f1-764f-46ed-a25a-b5418a91b17b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f4c1939c-4166-41e1-a915-af269583b53a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 47f989a2-c540-4e5c-8467-fa3a0078584e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:28:53 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:28:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:28:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHaeKuMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:28:55 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:28:55 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:28:55 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514602d-693b-4fac-9aa0-8a939a181609]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:28:55 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c463fed-08f4-4b92-82f9-f667098bc0e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c] added
Nov 15 01:28:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf99f2d-3684-4095-8efc-d2bba68f877e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfaad49-8f56-42f8-9949-f5f6ae0e8004]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHaeKuMo {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHaeKuMo" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c520c9e-1c05-4e30-9e97-67508aa93c09]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHaeKuMo'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c0cb17-a935-47ab-be95-d73e09ebe54e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[711f0508-66d1-42cd-8b85-29874d747d7c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd5eea-b593-486f-8ae0-93f5d00e22b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260]
Nov 15 01:28:55 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260] successful.
Nov 15 01:28:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[863d8984-9ec5-41f3-98a7-1c49c50a8f2d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[606caee1-049e-4dd3-a247-37662a1fd201]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c (non-flash)
Nov 15 01:28:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:28:55 user nova-compute[74880]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c (non-flash)
Nov 15 01:28:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2243180a-3968-40d8-b275-480e36911dd4]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHaeKuMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:28:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26535633765316235', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535633765316235', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:28:56 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:28:56 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:28:56 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:28:56 user nova-compute[74880]:   <serial>2923a934-8d73-4228-a116-da5722b0b36c</serial>
Nov 15 01:28:56 user nova-compute[74880]: </disk>
Nov 15 01:28:56 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Going to confirm migration 2 {{(pid=74880) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'info_cache' on Instance uuid b73970f1-764f-46ed-a25a-b5418a91b17b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:28:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No VIF found with MAC fa:16:3e:cf:05:d9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3502f993-4e84-42e2-96de-c8de86db5c6b tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.687s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'migration_context' on Instance uuid b73970f1-764f-46ed-a25a-b5418a91b17b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG nova.objects.base [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Object Instance<b73970f1-764f-46ed-a25a-b5418a91b17b> lazy-loaded attributes: info_cache,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:28:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.424s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:57 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Deleted allocation for migration 10bb13de-67d6-4d5a-b78f-7b84bb8488c7
Nov 15 01:28:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6163320f-ad7c-46bb-a7e8-add05bed573a tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.303s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:28:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:04 user nova-compute[74880]: INFO nova.compute.manager [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Detaching volume 2923a934-8d73-4228-a116-da5722b0b36c
Nov 15 01:29:05 user nova-compute[74880]: INFO nova.virt.block_device [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attempting to driver detach volume 2923a934-8d73-4228-a116-da5722b0b36c from mountpoint /dev/vdb
Nov 15 01:29:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Attempting to detach device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:29:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:29:05 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:29:05 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:29:05 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:29:05 user nova-compute[74880]:   <serial>2923a934-8d73-4228-a116-da5722b0b36c</serial>
Nov 15 01:29:05 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:29:05 user nova-compute[74880]: </disk>
Nov 15 01:29:05 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:29:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config.
Nov 15 01:29:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:29:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:29:05 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:29:05 user nova-compute[74880]:   <source dev="/dev/sdc"/>
Nov 15 01:29:05 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:29:05 user nova-compute[74880]:   <serial>2923a934-8d73-4228-a116-da5722b0b36c</serial>
Nov 15 01:29:05 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:29:05 user nova-compute[74880]: </disk>
Nov 15 01:29:05 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:29:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:29:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:08 user nova-compute[74880]: INFO nova.compute.manager [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Detaching volume babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:29:08 user nova-compute[74880]: INFO nova.virt.block_device [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Attempting to driver detach volume babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd from mountpoint /dev/vdb
Nov 15 01:29:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Attempting to detach device vdb from instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:29:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:29:08 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:29:08 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:29:08 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:29:08 user nova-compute[74880]:   <serial>babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd</serial>
Nov 15 01:29:08 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:29:08 user nova-compute[74880]: </disk>
Nov 15 01:29:08 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:29:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully detached device vdb from instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 from the persistent domain config.
Nov 15 01:29:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:29:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:29:08 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:29:08 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:29:08 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:29:08 user nova-compute[74880]:   <serial>babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd</serial>
Nov 15 01:29:08 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:29:08 user nova-compute[74880]: </disk>
Nov 15 01:29:08 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:29:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:29:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:25 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 is timed out.
Nov 15 01:29:25 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config.
Nov 15 01:29:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHaeKuMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:25 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd6280-ef5e-40e4-b22c-81569097465c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:29:25 user nova-compute[74880]: No targets found.
Nov 15 01:29:25 user nova-compute[74880]: iSNS:
Nov 15 01:29:25 user nova-compute[74880]: No targets found.
Nov 15 01:29:25 user nova-compute[74880]: STATIC:
Nov 15 01:29:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c
Nov 15 01:29:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:29:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:29:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:25 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:29:25 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:25 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:25 user nova-compute[74880]: FIRMWARE:
Nov 15 01:29:25 user nova-compute[74880]: No targets found.
Nov 15 01:29:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:29:25 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:29:25 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea649664-8058-44aa-a720-0ac422d59f06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d7a16-1b3c-4fed-a7e7-1f9c35be8fc3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:25 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:25 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:29:25 user nova-compute[74880]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c (non-flash)
Nov 15 01:29:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:25 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:25 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:29:25 user nova-compute[74880]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c (non-flash)
Nov 15 01:29:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f07a72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d8323-c86a-4c48-bd9d-fcd9481dcd26]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a279ef8c-660c-4b44-a64f-d46f6c6b0fec]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa2171-697e-4eb5-b91f-e7e4e4063408]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba2110d-e608-4731-b654-4641211f0714]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda13c7-4384-485e-8ede-5390555ae9c1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917f9a2-4e19-4895-891d-b466c1ac3110]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260]
Nov 15 01:29:25 user nova-compute[74880]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c, portal: 172.16.0.220,3260] successful.
Nov 15 01:29:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2923a934-8d73-4228-a116-da5722b0b36c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15a8a83-35ea-4ce9-ad43-fcfd01fb0554]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== disconnect_volume: return (332ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:29:26 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8e45becd-e37d-4068-aaf5-738aefe81a88 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:29 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 is timed out.
Nov 15 01:29:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully detached device vdb from instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 from the live domain config.
Nov 15 01:29:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOSKZcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:29 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[046eb562-dd9b-4591-8930-d77e9b92ca44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:29:29 user nova-compute[74880]: No targets found.
Nov 15 01:29:29 user nova-compute[74880]: iSNS:
Nov 15 01:29:29 user nova-compute[74880]: No targets found.
Nov 15 01:29:29 user nova-compute[74880]: STATIC:
Nov 15 01:29:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:29:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:29:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd
Nov 15 01:29:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:29:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:29:29 user nova-compute[74880]: FIRMWARE:
Nov 15 01:29:29 user nova-compute[74880]: No targets found.
Nov 15 01:29:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:29:29 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:29:29 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eced78d-21c1-432a-b2e0-6d893ce80ac5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa22e91-396c-4342-b00f-3d9dbc7a849d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:29 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:29 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:29:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:29 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:29 user nova-compute[74880]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd (non-flash)
Nov 15 01:29:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01da5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4dc4c-4d47-440d-859b-51fce7b25e9b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c3e28d-a7ca-4921-8a10-9c611e924a90]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[05caaf03-77a9-4aa7-933d-a5652883f7c5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c2f28e-6bb8-489f-95ac-66554f1623ef]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8fbce3-caf9-4dd5-a48f-23781fa7e915]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0b5539-9008-41c1-8616-b662236a386a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260]
Nov 15 01:29:29 user nova-compute[74880]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd, portal: 172.16.0.220,3260] successful.
Nov 15 01:29:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:babb1b6e-1d72-4a51-aeee-bc5bd5f7aecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c946f2ed-7822-4808-8ae5-d25463c045e9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== disconnect_volume: return (290ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:29:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6f3f0af2-03e0-4cd6-ad2c-c9e778240353 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74880) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-7593eac2-7af2-440a-b767-bb78c093a313 req-5b030a26-4bd2-443a-9661-6055336bf7b4 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7593eac2-7af2-440a-b767-bb78c093a313 req-5b030a26-4bd2-443a-9661-6055336bf7b4 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7593eac2-7af2-440a-b767-bb78c093a313 req-5b030a26-4bd2-443a-9661-6055336bf7b4 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7593eac2-7af2-440a-b767-bb78c093a313 req-5b030a26-4bd2-443a-9661-6055336bf7b4 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:31 user nova-compute[74880]: DEBUG nova.compute.manager [req-7593eac2-7af2-440a-b767-bb78c093a313 req-5b030a26-4bd2-443a-9661-6055336bf7b4 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:31 user nova-compute[74880]: WARNING nova.compute.manager [req-7593eac2-7af2-440a-b767-bb78c093a313 req-5b030a26-4bd2-443a-9661-6055336bf7b4 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state active and task_state powering-off.
Nov 15 01:29:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance destroyed successfully.
Nov 15 01:29:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:29:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bc02c5ec-8eb8-46f8-975d-20120a107504 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.854s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-ded6ef5c-d714-4fe5-93a2-49216abca6ca req-58bf9150-98f3-4967-b18b-9e3e61d2da39 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ded6ef5c-d714-4fe5-93a2-49216abca6ca req-58bf9150-98f3-4967-b18b-9e3e61d2da39 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ded6ef5c-d714-4fe5-93a2-49216abca6ca req-58bf9150-98f3-4967-b18b-9e3e61d2da39 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ded6ef5c-d714-4fe5-93a2-49216abca6ca req-58bf9150-98f3-4967-b18b-9e3e61d2da39 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-ded6ef5c-d714-4fe5-93a2-49216abca6ca req-58bf9150-98f3-4967-b18b-9e3e61d2da39 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:33 user nova-compute[74880]: WARNING nova.compute.manager [req-ded6ef5c-d714-4fe5-93a2-49216abca6ca req-58bf9150-98f3-4967-b18b-9e3e61d2da39 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state stopped and task_state None.
Nov 15 01:29:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-changed-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Refreshing instance network info cache due to event network-changed-11498cda-9b15-4829-80a6-c12044df9a93. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] Acquiring lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] Acquired lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Refreshing network info cache for port 11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updated VIF entry in instance network info cache for port 11498cda-9b15-4829-80a6-c12044df9a93. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updating instance_info_cache with network_info: [{"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8d9d083f-8a3b-4a6a-bd7b-8ca887275dd6 req-29b2817d-8c2a-48fd-9c36-15fd0d1b47cb service nova] Releasing lock "refresh_cache-f4c1939c-4166-41e1-a915-af269583b53a" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:29:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:29:38 user nova-compute[74880]: INFO nova.compute.claims [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Claim successful on node user
Nov 15 01:29:38 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:29:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:29:39 user nova-compute[74880]: INFO nova.virt.block_device [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Booting with volume 612a3339-6310-4f9f-81ac-0f1a213000b9 at /dev/vda
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.policy [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '484f6e472b2c4cb588dfab3cc9d3932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c2385409b4f5080bf3d81430ddbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG os_brick.utils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f574f-856c-4d38-883e-d470072c3c7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c5a9d7-2f75-4b37-80ba-84c46bda482c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d87c2e5-3993-438b-ad22-a0819a2c2f7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e917180e-ec7c-4a5b-abd0-145e811cd524]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:29:39 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb25ad-be02-49fd-953c-af963a3a01e1]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG os_brick.utils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updating existing volume attachment record: 7988e7c4-d44e-4a12-b515-77b12bdf11d5 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:39 user nova-compute[74880]: INFO nova.compute.manager [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Terminating instance
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.objects.instance [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:39 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Successfully created port: 94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:40 user nova-compute[74880]: INFO nova.compute.manager [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Attaching volume 6dbab67f-baee-4604-bcc8-58bf906f9871 to /dev/vdb
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-44e66026-5e4b-4d9a-b9ef-95fc354b4544 req-fe3ef09a-7b9e-4af2-9f71-5a336689c87c service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-unplugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-44e66026-5e4b-4d9a-b9ef-95fc354b4544 req-fe3ef09a-7b9e-4af2-9f71-5a336689c87c service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-44e66026-5e4b-4d9a-b9ef-95fc354b4544 req-fe3ef09a-7b9e-4af2-9f71-5a336689c87c service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-44e66026-5e4b-4d9a-b9ef-95fc354b4544 req-fe3ef09a-7b9e-4af2-9f71-5a336689c87c service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-44e66026-5e4b-4d9a-b9ef-95fc354b4544 req-fe3ef09a-7b9e-4af2-9f71-5a336689c87c service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-unplugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-44e66026-5e4b-4d9a-b9ef-95fc354b4544 req-fe3ef09a-7b9e-4af2-9f71-5a336689c87c service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-unplugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_brick.utils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4fb236-1014-4205-9be0-9a3c5a99af20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a21d0-f8ed-4825-8d64-3b9d29ed70f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4c7b4-9cd2-4765-9e43-ccebab1f8a12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c6375f-4765-4185-ab95-91a539227960]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:29:40 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f168a8-5bc1-484f-b3dd-89975a53e977]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_brick.utils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updating existing volume attachment record: cfae31ca-6c41-492e-b340-70c37826b6bd {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:29:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Instance destroyed successfully.
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'resources' on Instance uuid fc9fe17c-b782-44d0-8adc-3c42fde5af94 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737312131',display_name='tempest-ServerRescueNegativeTestJSON-server-1737312131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737312131',id=2,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:15:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-ja26cgna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:15:35Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=fc9fe17c-b782-44d0-8adc-3c42fde5af94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "e9b027ca-99e0-44f7-9658-785628855901", "address": "fa:16:3e:87:e8:d3", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b027ca-99", "ovs_interfaceid": "e9b027ca-99e0-44f7-9658-785628855901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG os_vif [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b027ca-99, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36e3f389-e55c-47f8-8838-a821f811d505) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:40 user nova-compute[74880]: INFO os_vif [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:e8:d3,bridge_name='br-int',has_traffic_filtering=True,id=e9b027ca-99e0-44f7-9658-785628855901,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b027ca-99')
Nov 15 01:29:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Deleting instance files /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94_del
Nov 15 01:29:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Deletion of /opt/stack/data/nova/instances/fc9fe17c-b782-44d0-8adc-3c42fde5af94_del complete
Nov 15 01:29:40 user nova-compute[74880]: INFO nova.compute.manager [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Successfully updated port: 94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquired lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-changed-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Refreshing instance network info cache due to event network-changed-94995e36-96d0-4fe6-9b98-2394ecac9544. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] Acquiring lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updating instance_info_cache with network_info: [{"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Releasing lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Instance network_info: |[{"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] Acquired lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Refreshing network info cache for port 94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:41 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Took 0.82 seconds to deallocate network for instance.
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updated VIF entry in instance network info cache for port 94995e36-96d0-4fe6-9b98-2394ecac9544. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updating instance_info_cache with network_info: [{"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b9df566-4cac-4d5a-a505-afaf8fc9473b req-7e1a5df8-ecf1-4ee2-a90e-e60271ecd90b service nova] Releasing lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:29:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:42 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Deleted allocations for instance fc9fe17c-b782-44d0-8adc-3c42fde5af94
Nov 15 01:29:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ef19969c-eb7b-440e-bcdc-1f8abc76fa52 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.448s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-81178c63-36e5-4f1d-96dd-ceb5351fefb5 req-87ec88c4-e490-4213-96c2-666bd8b1df47 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-81178c63-36e5-4f1d-96dd-ceb5351fefb5 req-87ec88c4-e490-4213-96c2-666bd8b1df47 service nova] Acquiring lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-81178c63-36e5-4f1d-96dd-ceb5351fefb5 req-87ec88c4-e490-4213-96c2-666bd8b1df47 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-81178c63-36e5-4f1d-96dd-ceb5351fefb5 req-87ec88c4-e490-4213-96c2-666bd8b1df47 service nova] Lock "fc9fe17c-b782-44d0-8adc-3c42fde5af94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-81178c63-36e5-4f1d-96dd-ceb5351fefb5 req-87ec88c4-e490-4213-96c2-666bd8b1df47 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] No waiting events found dispatching network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:42 user nova-compute[74880]: WARNING nova.compute.manager [req-81178c63-36e5-4f1d-96dd-ceb5351fefb5 req-87ec88c4-e490-4213-96c2-666bd8b1df47 service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received unexpected event network-vif-plugged-e9b027ca-99e0-44f7-9658-785628855901 for instance with vm_state deleted and task_state None.
Nov 15 01:29:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-9eff1f7c-1169-49fc-8055-fae2372699cb req-9ef88712-088a-446b-a490-0d87ec0ff41d service nova] [instance: fc9fe17c-b782-44d0-8adc-3c42fde5af94] Received event network-vif-deleted-e9b027ca-99e0-44f7-9658-785628855901 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:29:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Creating image(s)
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Ensure instance console log exists: /opt/stack/data/nova/instances/0f32696b-c386-48d2-aa46-9801f5356bfb/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Start _get_guest_xml network_info=[{"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZOIfwAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f32696b-c386-48d2-aa46-9801f5356bfb', 'attached_at': '', 'detached_at': '', 'volume_id': '612a3339-6310-4f9f-81ac-0f1a213000b9', 'serial': '612a3339-6310-4f9f-81ac-0f1a213000b9'}, 'mount_device': '/dev/vda', 'attachment_id': '7988e7c4-d44e-4a12-b515-77b12bdf11d5', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:29:44 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:29:44 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZOIfwAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:29:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:29:44 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a9fd2-e5af-41d7-9020-16127e3bfe9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:29:44 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[353e9e58-118e-4269-88d6-2395bcb77f07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9] added
Nov 15 01:29:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c25094a-e94a-4fb2-9c76-0ffbedb0bbf7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bff3f4-bcc3-446e-a594-dc795c53d612]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZOIfwAl {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZOIfwAl" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a622e6-14f2-4bd6-963c-967a99b55cd1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qZOIfwAl'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2918d08-88a3-42b3-9161-4729c2d745d0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bacd990-8d96-4c51-8ce7-bd58ba630ab0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:44 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:44 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1baf699-bc67-478c-a5c1-59ab6c2bb098]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260]
Nov 15 01:29:44 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260] successful.
Nov 15 01:29:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0b648-50e5-496c-aa9f-b2329a4b4899]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab5c0b-33d3-4a7d-8a04-157c0c48a941]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:44 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:44 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:29:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:44 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:44 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:29:44 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3c9c9e-4784-413a-9c60-5b78c8a07b38]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFXDLgxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:44 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:29:44 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZOIfwAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26336626431333937', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336626431333937', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.623s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:29:45 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:29:45 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-478274998',display_name='tempest-TestVolumeBootPattern-volume-backed-server-478274998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-478274998',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg0XQlhwQiDsN+v3wkFhYdzKxFu9LzQSZyRf4M4K1ZvD/FCqBy/0AdU4Hv9TPT09QrcAqASOrmUmqcOWa4l+5bbrmD25XcA6u6TlDnhayHZBQ30hex8EKvYifLVQnTsyw==',key_name='tempest-keypair-1714674865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-z0z9ss2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=0f32696b-c386-48d2-aa46-9801f5356bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f32696b-c386-48d2-aa46-9801f5356bfb {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ce563a-930d-4ac2-b744-80ab71c28d68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:29:45 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:29:45 user nova-compute[74880]:   <uuid>0f32696b-c386-48d2-aa46-9801f5356bfb</uuid>
Nov 15 01:29:45 user nova-compute[74880]:   <name>instance-00000024</name>
Nov 15 01:29:45 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:29:45 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:29:45 user nova-compute[74880]:   <metadata>
Nov 15 01:29:45 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:29:45 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:29:45 user nova-compute[74880]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-478274998</nova:name>
Nov 15 01:29:45 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:29:44</nova:creationTime>
Nov 15 01:29:45 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:29:45 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:29:45 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:29:45 user nova-compute[74880]:       <nova:owner>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:user uuid="484f6e472b2c4cb588dfab3cc9d3932a">tempest-TestVolumeBootPattern-1434286508-project-member</nova:user>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:project uuid="861c2385409b4f5080bf3d81430ddbf0">tempest-TestVolumeBootPattern-1434286508</nova:project>
Nov 15 01:29:45 user nova-compute[74880]:       </nova:owner>
Nov 15 01:29:45 user nova-compute[74880]:       <nova:ports>
Nov 15 01:29:45 user nova-compute[74880]:         <nova:port uuid="94995e36-96d0-4fe6-9b98-2394ecac9544">
Nov 15 01:29:45 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 01:29:45 user nova-compute[74880]:         </nova:port>
Nov 15 01:29:45 user nova-compute[74880]:       </nova:ports>
Nov 15 01:29:45 user nova-compute[74880]:     </nova:instance>
Nov 15 01:29:45 user nova-compute[74880]:   </metadata>
Nov 15 01:29:45 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:29:45 user nova-compute[74880]:     <system>
Nov 15 01:29:45 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:29:45 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:29:45 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:29:45 user nova-compute[74880]:       <entry name="serial">0f32696b-c386-48d2-aa46-9801f5356bfb</entry>
Nov 15 01:29:45 user nova-compute[74880]:       <entry name="uuid">0f32696b-c386-48d2-aa46-9801f5356bfb</entry>
Nov 15 01:29:45 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:29:45 user nova-compute[74880]:     </system>
Nov 15 01:29:45 user nova-compute[74880]:   </sysinfo>
Nov 15 01:29:45 user nova-compute[74880]:   <os>
Nov 15 01:29:45 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:29:45 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:29:45 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:29:45 user nova-compute[74880]:   </os>
Nov 15 01:29:45 user nova-compute[74880]:   <features>
Nov 15 01:29:45 user nova-compute[74880]:     <acpi/>
Nov 15 01:29:45 user nova-compute[74880]:     <apic/>
Nov 15 01:29:45 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:29:45 user nova-compute[74880]:   </features>
Nov 15 01:29:45 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:29:45 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:29:45 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:29:45 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:29:45 user nova-compute[74880]:   </clock>
Nov 15 01:29:45 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:29:45 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:29:45 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:29:45 user nova-compute[74880]:   </cpu>
Nov 15 01:29:45 user nova-compute[74880]:   <devices>
Nov 15 01:29:45 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:29:45 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:29:45 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:29:45 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:29:45 user nova-compute[74880]:       <serial>612a3339-6310-4f9f-81ac-0f1a213000b9</serial>
Nov 15 01:29:45 user nova-compute[74880]:     </disk>
Nov 15 01:29:45 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:29:45 user nova-compute[74880]:       <mac address="fa:16:3e:2b:a3:9d"/>
Nov 15 01:29:45 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:29:45 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:29:45 user nova-compute[74880]:       <target dev="tap94995e36-96"/>
Nov 15 01:29:45 user nova-compute[74880]:     </interface>
Nov 15 01:29:45 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:29:45 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/0f32696b-c386-48d2-aa46-9801f5356bfb/console.log" append="off"/>
Nov 15 01:29:45 user nova-compute[74880]:     </serial>
Nov 15 01:29:45 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:29:45 user nova-compute[74880]:     <video>
Nov 15 01:29:45 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:29:45 user nova-compute[74880]:     </video>
Nov 15 01:29:45 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:29:45 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:29:45 user nova-compute[74880]:     </rng>
Nov 15 01:29:45 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:29:45 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:29:45 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:29:45 user nova-compute[74880]:     </memballoon>
Nov 15 01:29:45 user nova-compute[74880]:   </devices>
Nov 15 01:29:45 user nova-compute[74880]: </domain>
Nov 15 01:29:45 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-478274998',display_name='tempest-TestVolumeBootPattern-volume-backed-server-478274998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-478274998',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg0XQlhwQiDsN+v3wkFhYdzKxFu9LzQSZyRf4M4K1ZvD/FCqBy/0AdU4Hv9TPT09QrcAqASOrmUmqcOWa4l+5bbrmD25XcA6u6TlDnhayHZBQ30hex8EKvYifLVQnTsyw==',key_name='tempest-keypair-1714674865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-z0z9ss2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=0f32696b-c386-48d2-aa46-9801f5356bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_vif [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c62b80dd-b129-5e1a-8822-e7e660a79930', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea075084-c2ee-4119-88be-1fb826815d46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871] added
Nov 15 01:29:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94995e36-96, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94995e36-96, col_values=(('qos', UUID('df45a42a-202d-431d-bcc5-070d83073d0d')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94995e36-96, col_values=(('external_ids', {'iface-id': '94995e36-96d0-4fe6-9b98-2394ecac9544', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:a3:9d', 'vm-uuid': '0f32696b-c386-48d2-aa46-9801f5356bfb'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c1ddf2-8305-4208-9fa7-7ccd0839f2e0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:45 user nova-compute[74880]: INFO os_vif [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96')
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf73e3f-4554-456d-bf2e-5cc009d4bda1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFXDLgxk {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFXDLgxk" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c44e06-6061-4215-9a17-d858bc64ee2f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HFXDLgxk'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No VIF found with MAC fa:16:3e:2b:a3:9d, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bf910b-a129-477c-9203-4ccde6c52c65]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c3b38-6acc-4e71-8be5-d889c3616b34]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:29:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:29:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb2710-5c92-44f6-bec7-06bd72665329]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260]
Nov 15 01:29:45 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260] successful.
Nov 15 01:29:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac70ae9-ad3f-4f5c-bd18-7b200ff0c9c5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02c8021-1754-46fb-9552-000e08d75661]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:29:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:29:45 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:29:45 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e485ff5-ffc7-4cd3-936f-50c3903232b4]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:45 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFXDLgxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== connect_volume: return (1957ms) {'type': 'block', 'scsi_wwn': '23131376232373530', 'path': '/dev/sde'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131376232373530', 'path': '/dev/sde'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG nova.objects.instance [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:29:46 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:29:46 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:29:46 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:29:46 user nova-compute[74880]:   <serial>6dbab67f-baee-4604-bcc8-58bf906f9871</serial>
Nov 15 01:29:46 user nova-compute[74880]: </disk>
Nov 15 01:29:46 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-40fe186d-ff49-497c-962a-7098e1448563 req-240e7c72-1f0f-4db3-9d9a-2600f315d6c3 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-40fe186d-ff49-497c-962a-7098e1448563 req-240e7c72-1f0f-4db3-9d9a-2600f315d6c3 service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-40fe186d-ff49-497c-962a-7098e1448563 req-240e7c72-1f0f-4db3-9d9a-2600f315d6c3 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-40fe186d-ff49-497c-962a-7098e1448563 req-240e7c72-1f0f-4db3-9d9a-2600f315d6c3 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-40fe186d-ff49-497c-962a-7098e1448563 req-240e7c72-1f0f-4db3-9d9a-2600f315d6c3 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:47 user nova-compute[74880]: WARNING nova.compute.manager [req-40fe186d-ff49-497c-962a-7098e1448563 req-240e7c72-1f0f-4db3-9d9a-2600f315d6c3 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received unexpected event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with vm_state building and task_state spawning.
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:86:a1:b9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-117a4171-2fca-4e7f-91ef-7f481e96ce83 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.560s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:29:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:48 user nova-compute[74880]: INFO nova.compute.manager [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Unrescuing
Nov 15 01:29:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG nova.objects.instance [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'flavor' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:49 user nova-compute[74880]: WARNING nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received unexpected event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with vm_state building and task_state spawning.
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:49 user nova-compute[74880]: WARNING nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:49 user nova-compute[74880]: WARNING nova.compute.manager [req-179522ab-5243-4800-9835-e389eb95ce17 req-af1ed63b-f796-4ff5-9a7c-84c35db8657d service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:29:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance destroyed successfully.
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:29:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Instance spawned successfully.
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:49 user nova-compute[74880]: INFO nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 15 01:29:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:49 user nova-compute[74880]: INFO nova.compute.manager [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Took 11.14 seconds to build instance.
Nov 15 01:29:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0a52a0e0-83ab-4cb1-bd96-62365039f297 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.244s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:29:51 user nova-compute[74880]: INFO nova.compute.claims [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Claim successful on node user
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:51 user nova-compute[74880]: WARNING nova.compute.manager [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:51 user nova-compute[74880]: WARNING nova.compute.manager [req-07a5e76d-3d4f-4483-b021-3d360cad445d req-7f2687d8-c883-447a-9bb6-372f11095187 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:29:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.policy [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dd436c8ece5405789f44db4c8349c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9537a43f73f472c9d8c90ed75d72e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:29:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Creating image(s)
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "/opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk 1073741824" returned: 0 in 0.053s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-df8194f8-0f99-4cea-814e-a12ffb4e424e tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Successfully created port: db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Cannot resize image /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Ensure instance console log exists: /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Successfully updated port: db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquired lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-changed-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Refreshing instance network info cache due to event network-changed-db1e3afe-4fae-43c5-b13a-86ad392e2e3e. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] Acquiring lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:29:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.neutron [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Updating instance_info_cache with network_info: [{"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Releasing lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Instance network_info: |[{"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] Acquired lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Refreshing network info cache for port db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Start _get_guest_xml network_info=[{"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:29:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:29:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-80908015',display_name='tempest-AttachVolumeNegativeTest-server-80908015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-80908015',id=37,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpIYys8tO+w4z7ZMXvJ5hnu9K+JeX5k4JIzWQI8KhuhboxnKTbltqyOsXkUb40hr+jBYlU6vCSv1xSZsGaWEK0gCR1Ya60Ywc1EA+WoO2TzwfvWL/ULugcF/nMz0SWtsQ==',key_name='tempest-keypair-298967234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-3ke4pe23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=8006f0c9-454b-459e-8711-205b0c2d5a62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.objects.instance [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'pci_devices' on Instance uuid 8006f0c9-454b-459e-8711-205b0c2d5a62 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:29:54 user nova-compute[74880]:   <uuid>8006f0c9-454b-459e-8711-205b0c2d5a62</uuid>
Nov 15 01:29:54 user nova-compute[74880]:   <name>instance-00000025</name>
Nov 15 01:29:54 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:29:54 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:29:54 user nova-compute[74880]:   <metadata>
Nov 15 01:29:54 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:29:54 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:29:54 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeNegativeTest-server-80908015</nova:name>
Nov 15 01:29:54 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:29:54</nova:creationTime>
Nov 15 01:29:54 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:29:54 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:29:54 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:29:54 user nova-compute[74880]:       <nova:owner>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:user uuid="1dd436c8ece5405789f44db4c8349c97">tempest-AttachVolumeNegativeTest-1148149593-project-member</nova:user>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:project uuid="c9537a43f73f472c9d8c90ed75d72e2d">tempest-AttachVolumeNegativeTest-1148149593</nova:project>
Nov 15 01:29:54 user nova-compute[74880]:       </nova:owner>
Nov 15 01:29:54 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:29:54 user nova-compute[74880]:       <nova:ports>
Nov 15 01:29:54 user nova-compute[74880]:         <nova:port uuid="db1e3afe-4fae-43c5-b13a-86ad392e2e3e">
Nov 15 01:29:54 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:29:54 user nova-compute[74880]:         </nova:port>
Nov 15 01:29:54 user nova-compute[74880]:       </nova:ports>
Nov 15 01:29:54 user nova-compute[74880]:     </nova:instance>
Nov 15 01:29:54 user nova-compute[74880]:   </metadata>
Nov 15 01:29:54 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:29:54 user nova-compute[74880]:     <system>
Nov 15 01:29:54 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:29:54 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:29:54 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:29:54 user nova-compute[74880]:       <entry name="serial">8006f0c9-454b-459e-8711-205b0c2d5a62</entry>
Nov 15 01:29:54 user nova-compute[74880]:       <entry name="uuid">8006f0c9-454b-459e-8711-205b0c2d5a62</entry>
Nov 15 01:29:54 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:29:54 user nova-compute[74880]:     </system>
Nov 15 01:29:54 user nova-compute[74880]:   </sysinfo>
Nov 15 01:29:54 user nova-compute[74880]:   <os>
Nov 15 01:29:54 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:29:54 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:29:54 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:29:54 user nova-compute[74880]:   </os>
Nov 15 01:29:54 user nova-compute[74880]:   <features>
Nov 15 01:29:54 user nova-compute[74880]:     <acpi/>
Nov 15 01:29:54 user nova-compute[74880]:     <apic/>
Nov 15 01:29:54 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:29:54 user nova-compute[74880]:   </features>
Nov 15 01:29:54 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:29:54 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:29:54 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:29:54 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:29:54 user nova-compute[74880]:   </clock>
Nov 15 01:29:54 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:29:54 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:29:54 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:29:54 user nova-compute[74880]:   </cpu>
Nov 15 01:29:54 user nova-compute[74880]:   <devices>
Nov 15 01:29:54 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:29:54 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:29:54 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk"/>
Nov 15 01:29:54 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:29:54 user nova-compute[74880]:     </disk>
Nov 15 01:29:54 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:29:54 user nova-compute[74880]:       <mac address="fa:16:3e:1f:23:68"/>
Nov 15 01:29:54 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:29:54 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:29:54 user nova-compute[74880]:       <target dev="tapdb1e3afe-4f"/>
Nov 15 01:29:54 user nova-compute[74880]:     </interface>
Nov 15 01:29:54 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:29:54 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/console.log" append="off"/>
Nov 15 01:29:54 user nova-compute[74880]:     </serial>
Nov 15 01:29:54 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:29:54 user nova-compute[74880]:     <video>
Nov 15 01:29:54 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:29:54 user nova-compute[74880]:     </video>
Nov 15 01:29:54 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:29:54 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:29:54 user nova-compute[74880]:     </rng>
Nov 15 01:29:54 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:29:54 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:29:54 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:29:54 user nova-compute[74880]:     </memballoon>
Nov 15 01:29:54 user nova-compute[74880]:   </devices>
Nov 15 01:29:54 user nova-compute[74880]: </domain>
Nov 15 01:29:54 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-80908015',display_name='tempest-AttachVolumeNegativeTest-server-80908015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-80908015',id=37,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpIYys8tO+w4z7ZMXvJ5hnu9K+JeX5k4JIzWQI8KhuhboxnKTbltqyOsXkUb40hr+jBYlU6vCSv1xSZsGaWEK0gCR1Ya60Ywc1EA+WoO2TzwfvWL/ULugcF/nMz0SWtsQ==',key_name='tempest-keypair-298967234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-3ke4pe23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=8006f0c9-454b-459e-8711-205b0c2d5a62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG os_vif [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd5bbffe-5a69-57c1-aae1-dac3c4241002', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb1e3afe-4f, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb1e3afe-4f, col_values=(('qos', UUID('f0560f26-86d2-49ba-a6e7-c17dc5464313')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb1e3afe-4f, col_values=(('external_ids', {'iface-id': 'db1e3afe-4fae-43c5-b13a-86ad392e2e3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:23:68', 'vm-uuid': '8006f0c9-454b-459e-8711-205b0c2d5a62'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:54 user nova-compute[74880]: INFO os_vif [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f')
Nov 15 01:29:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:29:54 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=25.288604736328125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:1f:23:68, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance b73970f1-764f-46ed-a25a-b5418a91b17b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f4c1939c-4166-41e1-a915-af269583b53a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 47f989a2-c540-4e5c-8467-fa3a0078584e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0f32696b-c386-48d2-aa46-9801f5356bfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8006f0c9-454b-459e-8711-205b0c2d5a62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Updated VIF entry in instance network info cache for port db1e3afe-4fae-43c5-b13a-86ad392e2e3e. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:29:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Updating instance_info_cache with network_info: [{"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-53d6c4bd-c976-46b3-ab1a-d181526b54d0 req-612d7df0-5a9a-4597-9c0b-dfe90b864e93 service nova] Releasing lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:55 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:29:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:29:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:29:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-4618c471-5f09-4a59-93a9-7b8d7fc6a39d req-379f7dc3-21b1-47ab-bb26-89b4ee3df63b service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4618c471-5f09-4a59-93a9-7b8d7fc6a39d req-379f7dc3-21b1-47ab-bb26-89b4ee3df63b service nova] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4618c471-5f09-4a59-93a9-7b8d7fc6a39d req-379f7dc3-21b1-47ab-bb26-89b4ee3df63b service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4618c471-5f09-4a59-93a9-7b8d7fc6a39d req-379f7dc3-21b1-47ab-bb26-89b4ee3df63b service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-4618c471-5f09-4a59-93a9-7b8d7fc6a39d req-379f7dc3-21b1-47ab-bb26-89b4ee3df63b service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] No waiting events found dispatching network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:56 user nova-compute[74880]: WARNING nova.compute.manager [req-4618c471-5f09-4a59-93a9-7b8d7fc6a39d req-379f7dc3-21b1-47ab-bb26-89b4ee3df63b service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received unexpected event network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e for instance with vm_state building and task_state spawning.
Nov 15 01:29:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG nova.objects.instance [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:57 user nova-compute[74880]: INFO nova.compute.manager [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attaching volume ea753ec1-363e-4eb0-a4a3-05e7a21951e4 to /dev/vdb
Nov 15 01:29:57 user nova-compute[74880]: DEBUG os_brick.utils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703d17f-e095-4fd8-8c1e-4c93f7d6323c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92caa1fb-7f6e-41c4-96f5-35229b4d5dbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd48ba78-f435-4bef-88e1-1650b2f56bfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0404f751-ac20-4eb9-8247-a84b33dd26ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:29:57 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a279ad6-af4b-44c7-bed2-299e5ebf7fd2]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG os_brick.utils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating existing volume attachment record: 620fbc5e-755b-4624-9f9c-a7cc6212cddc {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:29:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Instance spawned successfully.
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-7993e347-9a22-4cf0-968d-4fe785061827 req-733cb977-56a6-4e8d-b58a-9d37f68f2ea1 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7993e347-9a22-4cf0-968d-4fe785061827 req-733cb977-56a6-4e8d-b58a-9d37f68f2ea1 service nova] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7993e347-9a22-4cf0-968d-4fe785061827 req-733cb977-56a6-4e8d-b58a-9d37f68f2ea1 service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7993e347-9a22-4cf0-968d-4fe785061827 req-733cb977-56a6-4e8d-b58a-9d37f68f2ea1 service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-7993e347-9a22-4cf0-968d-4fe785061827 req-733cb977-56a6-4e8d-b58a-9d37f68f2ea1 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] No waiting events found dispatching network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:29:58 user nova-compute[74880]: WARNING nova.compute.manager [req-7993e347-9a22-4cf0-968d-4fe785061827 req-733cb977-56a6-4e8d-b58a-9d37f68f2ea1 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received unexpected event network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e for instance with vm_state building and task_state spawning.
Nov 15 01:29:58 user nova-compute[74880]: INFO nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 15 01:29:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:29:58 user nova-compute[74880]: INFO nova.compute.manager [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Took 7.33 seconds to build instance.
Nov 15 01:29:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-a113044e-546a-43e9-80af-6d471b1609e0 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.426s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:29:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWMFeUwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:30:02 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:30:02 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:30:02 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf5c87-d7ed-4491-830b-24afc8006193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:30:02 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade6327a-bcd4-445c-ab15-73cdea165254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4] added
Nov 15 01:30:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b0ed5-e195-41c6-ae1b-97633dc175d5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503b411-9706-47e3-a41c-84f4c1717291]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWMFeUwV {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWMFeUwV" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f22a3d-a6d2-4c39-89fd-9527ec455382]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWMFeUwV'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6ddec-0379-454a-bd89-c05fb233c46f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ac279-5475-468c-a41e-2107787181a0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3558813-152a-49c6-9361-fe6ffa7949d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260]
Nov 15 01:30:02 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260] successful.
Nov 15 01:30:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83628e3-29b3-4b5c-97fe-132004b1d00b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510bd83-231d-4e32-a8d3-468d8f33b866]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 (non-flash)
Nov 15 01:30:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad82d4e2-a669-4c9e-93db-9069ff1bbe18]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWMFeUwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23531656333313761', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531656333313761', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG nova.objects.instance [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:30:03 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:30:03 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:30:03 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:30:03 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:30:03 user nova-compute[74880]:   <serial>ea753ec1-363e-4eb0-a4a3-05e7a21951e4</serial>
Nov 15 01:30:03 user nova-compute[74880]: </disk>
Nov 15 01:30:03 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:30:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:30:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:30:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No VIF found with MAC fa:16:3e:cf:05:d9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:30:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cfa053da-3f44-4ed0-a7e7-ea0147b88287 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.123s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:07 user nova-compute[74880]: INFO nova.compute.manager [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Detaching volume ea753ec1-363e-4eb0-a4a3-05e7a21951e4
Nov 15 01:30:07 user nova-compute[74880]: INFO nova.virt.block_device [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attempting to driver detach volume ea753ec1-363e-4eb0-a4a3-05e7a21951e4 from mountpoint /dev/vdb
Nov 15 01:30:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Attempting to detach device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:30:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:30:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:30:07 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:30:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:30:07 user nova-compute[74880]:   <serial>ea753ec1-363e-4eb0-a4a3-05e7a21951e4</serial>
Nov 15 01:30:07 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:30:07 user nova-compute[74880]: </disk>
Nov 15 01:30:07 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:30:07 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config.
Nov 15 01:30:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:30:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:30:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:30:07 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:30:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:30:07 user nova-compute[74880]:   <serial>ea753ec1-363e-4eb0-a4a3-05e7a21951e4</serial>
Nov 15 01:30:07 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:30:07 user nova-compute[74880]: </disk>
Nov 15 01:30:07 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:30:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:30:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid b73970f1-764f-46ed-a25a-b5418a91b17b {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 47f989a2-c540-4e5c-8467-fa3a0078584e {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 0f32696b-c386-48d2-aa46-9801f5356bfb {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 8006f0c9-454b-459e-8711-205b0c2d5a62 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "f4c1939c-4166-41e1-a915-af269583b53a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "f4c1939c-4166-41e1-a915-af269583b53a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:22 user nova-compute[74880]: INFO nova.compute.manager [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Terminating instance
Nov 15 01:30:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-03c8727b-b46b-4105-85ff-1a52b7d40da3 req-61d0514f-c755-410d-898f-e82c24fb9376 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-unplugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-03c8727b-b46b-4105-85ff-1a52b7d40da3 req-61d0514f-c755-410d-898f-e82c24fb9376 service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-03c8727b-b46b-4105-85ff-1a52b7d40da3 req-61d0514f-c755-410d-898f-e82c24fb9376 service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-03c8727b-b46b-4105-85ff-1a52b7d40da3 req-61d0514f-c755-410d-898f-e82c24fb9376 service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-03c8727b-b46b-4105-85ff-1a52b7d40da3 req-61d0514f-c755-410d-898f-e82c24fb9376 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-unplugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-03c8727b-b46b-4105-85ff-1a52b7d40da3 req-61d0514f-c755-410d-898f-e82c24fb9376 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-unplugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Instance destroyed successfully.
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lazy-loading 'resources' on Instance uuid 47f989a2-c540-4e5c-8467-fa3a0078584e {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1367521512',display_name='tempest-VolumesNegativeTest-instance-1367521512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1367521512',id=35,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:28:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da296ba5e9134ebf868a14e5d7551171',ramdisk_id='',reservation_id='r-u8yzo0ut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-640510573',owner_user_name='tempest-VolumesNegativeTest-640510573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:28:38Z,user_data=None,user_id='e6c1330cee67401fa675438a80aeb093',uuid=47f989a2-c540-4e5c-8467-fa3a0078584e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Converting VIF {"id": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "address": "fa:16:3e:e5:4b:47", "network": {"id": "2eaf2c3d-020d-419b-ab8f-ef03c33db271", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e99168cf57ab48bd8105fd05bffb6e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c15e41-89", "ovs_interfaceid": "92c15e41-890c-4f6b-9a84-03c880c55f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG os_vif [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92c15e41-89, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecdbb3fb-d701-4d9e-b346-1d5c872f4291) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: INFO os_vif [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4b:47,bridge_name='br-int',has_traffic_filtering=True,id=92c15e41-890c-4f6b-9a84-03c880c55f1d,network=Network(2eaf2c3d-020d-419b-ab8f-ef03c33db271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c15e41-89')
Nov 15 01:30:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Deleting instance files /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e_del
Nov 15 01:30:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Deletion of /opt/stack/data/nova/instances/47f989a2-c540-4e5c-8467-fa3a0078584e_del complete
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: INFO nova.compute.manager [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 01:30:23 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:30:23 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Took 0.60 seconds to deallocate network for instance.
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-3d753916-8c12-44d3-82a3-3ff73b048e5a req-dce538e7-b971-47e8-b68e-c3a529011c96 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-deleted-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:23 user nova-compute[74880]: INFO nova.compute.manager [req-3d753916-8c12-44d3-82a3-3ff73b048e5a req-dce538e7-b971-47e8-b68e-c3a529011c96 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Neutron deleted interface 92c15e41-890c-4f6b-9a84-03c880c55f1d; detaching it from the instance and deleting it from the info cache
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-3d753916-8c12-44d3-82a3-3ff73b048e5a req-dce538e7-b971-47e8-b68e-c3a529011c96 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-3d753916-8c12-44d3-82a3-3ff73b048e5a req-dce538e7-b971-47e8-b68e-c3a529011c96 service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Detach interface failed, port_id=92c15e41-890c-4f6b-9a84-03c880c55f1d, reason: Instance 47f989a2-c540-4e5c-8467-fa3a0078584e could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Deleted allocations for instance 47f989a2-c540-4e5c-8467-fa3a0078584e
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8effc000-7478-4e29-935c-845c5ba56a10 tempest-VolumesNegativeTest-640510573 tempest-VolumesNegativeTest-640510573-project-member] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:24 user nova-compute[74880]: WARNING nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state deleted and task_state None.
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:24 user nova-compute[74880]: WARNING nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state deleted and task_state None.
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:24 user nova-compute[74880]: WARNING nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state deleted and task_state None.
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-unplugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-unplugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:24 user nova-compute[74880]: WARNING nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-unplugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state deleted and task_state None.
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Acquiring lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] Lock "47f989a2-c540-4e5c-8467-fa3a0078584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] No waiting events found dispatching network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:24 user nova-compute[74880]: WARNING nova.compute.manager [req-60316ce2-5346-4dcf-9c40-5076c79a5dc4 req-31293db2-3ead-4a6b-bde0-9428a529798f service nova] [instance: 47f989a2-c540-4e5c-8467-fa3a0078584e] Received unexpected event network-vif-plugged-92c15e41-890c-4f6b-9a84-03c880c55f1d for instance with vm_state deleted and task_state None.
Nov 15 01:30:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:28 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 is timed out.
Nov 15 01:30:28 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config.
Nov 15 01:30:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWMFeUwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:30:28 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796162d-bd20-47a2-970a-2437813f5562]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:30:28 user nova-compute[74880]: No targets found.
Nov 15 01:30:28 user nova-compute[74880]: iSNS:
Nov 15 01:30:28 user nova-compute[74880]: No targets found.
Nov 15 01:30:28 user nova-compute[74880]: STATIC:
Nov 15 01:30:28 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871
Nov 15 01:30:28 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:30:28 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:30:28 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4
Nov 15 01:30:28 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:30:28 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:30:28 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:30:28 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:30:28 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:30:28 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:30:28 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:30:28 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:30:28 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:30:28 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:30:28 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:30:28 user nova-compute[74880]: FIRMWARE:
Nov 15 01:30:28 user nova-compute[74880]: No targets found.
Nov 15 01:30:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:30:28 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:30:28 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae1a709-d410-4711-9549-bc0089e5857c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef0759-5438-4c62-8a6c-66acbb7c1a30]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 (non-flash)
Nov 15 01:30:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:30:28 user nova-compute[74880]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 (non-flash)
Nov 15 01:30:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d0624dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[35909f57-3e2e-406b-a48d-b664d1b170ca]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d56f155-8556-4d14-92d5-7e62760c10cd]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c31e9a8-abff-49fd-97e8-4ac44f1872cb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4eae3a-ee0a-4b08-87d3-9f2badeb2bc3]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4d7b5-be4f-4f52-ac85-f0d178cd1b3a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf19884-81d5-4d22-a6f5-790f92de618c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260]
Nov 15 01:30:28 user nova-compute[74880]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4, portal: 172.16.0.220,3260] successful.
Nov 15 01:30:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea753ec1-363e-4eb0-a4a3-05e7a21951e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280f638-7d39-4ba9-a7ff-98d7a5757187]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== disconnect_volume: return (296ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:30:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:30:29 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:30:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0968bb82-c82e-4dfa-a6d8-53f718892e33 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.679s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:30 user nova-compute[74880]: INFO nova.compute.manager [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Terminating instance
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-68a42413-5fdc-4127-aa62-d1cd1cc0c1b5 req-076cf2b0-0fa5-4861-b6d9-6d4be33b1869 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68a42413-5fdc-4127-aa62-d1cd1cc0c1b5 req-076cf2b0-0fa5-4861-b6d9-6d4be33b1869 service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68a42413-5fdc-4127-aa62-d1cd1cc0c1b5 req-076cf2b0-0fa5-4861-b6d9-6d4be33b1869 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68a42413-5fdc-4127-aa62-d1cd1cc0c1b5 req-076cf2b0-0fa5-4861-b6d9-6d4be33b1869 service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-68a42413-5fdc-4127-aa62-d1cd1cc0c1b5 req-076cf2b0-0fa5-4861-b6d9-6d4be33b1869 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-68a42413-5fdc-4127-aa62-d1cd1cc0c1b5 req-076cf2b0-0fa5-4861-b6d9-6d4be33b1869 service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-unplugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:30:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Instance destroyed successfully.
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lazy-loading 'resources' on Instance uuid 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1651043979',display_name='tempest-ServerRescueNegativeTestJSON-server-1651043979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1651043979',id=1,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d96e59bffc2b4c99940e4c87ad82521e',ramdisk_id='',reservation_id='r-9rf0n0nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212122190',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212122190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:20:19Z,user_data=None,user_id='7c88b23d691c4cdc98757d0af8ab27c1',uuid=67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converting VIF {"id": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "address": "fa:16:3e:ba:aa:8e", "network": {"id": "f83462c9-3299-4809-931e-e65d35430c8f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1180295954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d96e59bffc2b4c99940e4c87ad82521e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425e2abd-4b", "ovs_interfaceid": "425e2abd-4b97-45d3-bf1d-83aee8ad920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG os_vif [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap425e2abd-4b, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64141296-05a5-442b-9249-828d460b04ca) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:30:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:30 user nova-compute[74880]: INFO os_vif [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:aa:8e,bridge_name='br-int',has_traffic_filtering=True,id=425e2abd-4b97-45d3-bf1d-83aee8ad920d,network=Network(f83462c9-3299-4809-931e-e65d35430c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425e2abd-4b')
Nov 15 01:30:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Deleting instance files /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0_del
Nov 15 01:30:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Deletion of /opt/stack/data/nova/instances/67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0_del complete
Nov 15 01:30:31 user nova-compute[74880]: INFO nova.compute.manager [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 15 01:30:31 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:30:31 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Took 0.45 seconds to deallocate network for instance.
Nov 15 01:30:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:30:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:31 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Deleted allocations for instance 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0
Nov 15 01:30:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ab9c3a04-e098-4a6f-8636-01131a16f7f2 tempest-ServerRescueNegativeTestJSON-1212122190 tempest-ServerRescueNegativeTestJSON-1212122190-project-member] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.765s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] Acquiring lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] Lock "67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] No waiting events found dispatching network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:30:32 user nova-compute[74880]: WARNING nova.compute.manager [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received unexpected event network-vif-plugged-425e2abd-4b97-45d3-bf1d-83aee8ad920d for instance with vm_state deleted and task_state None.
Nov 15 01:30:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-d93da228-a0a6-410c-ad23-be9d1ef8f627 req-2fc5c7c6-a14d-4b41-b8cc-fff39241086a service nova] [instance: 67d8a35f-18a9-4f87-ac21-4fdc2d27bfd0] Received event network-vif-deleted-425e2abd-4b97-45d3-bf1d-83aee8ad920d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:30:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:47 user nova-compute[74880]: INFO nova.compute.manager [None req-c3fdee99-d148-492d-a71b-f9d48e598bac tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Get console output
Nov 15 01:30:47 user nova-compute[74880]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 01:30:49 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:50 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:51 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:30:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:30:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:30:51 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [{"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-b73970f1-764f-46ed-a25a-b5418a91b17b" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:30:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:30:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:30:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.29165267944336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance b73970f1-764f-46ed-a25a-b5418a91b17b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f4c1939c-4166-41e1-a915-af269583b53a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0f32696b-c386-48d2-aa46-9801f5356bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8006f0c9-454b-459e-8711-205b0c2d5a62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:30:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:30:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:30:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:30:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:30:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:30:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:30:59 user nova-compute[74880]: INFO nova.compute.manager [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attaching volume c6e02c49-608d-4c5f-806e-9a6c8ea85eed to /dev/vdb
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG os_brick.utils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a083a8-feea-4009-95a2-e48b76802545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c9bba-423f-4cea-aa8f-4c1571bd4228]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[966dfc28-55c7-4bef-bc87-267d2b9602a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e18921-388f-40c4-9eac-2653849df3ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:31:00 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:31:00 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45e67a-3b49-4e04-b508-97b39dcac892]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG os_brick.utils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating existing volume attachment record: 1fd94017-4bb0-4d68-aa07-f51f469d248f {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:31:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmfyEwNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:31:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:31:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:31:04 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2b5e4-cfc7-4ce0-b6a8-cd35bcec6539]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:31:04 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87aa69e-ca86-4e06-9ec5-e9a3cb54939b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed] added
Nov 15 01:31:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[241fc7a5-4d7b-4d19-b3f4-b027a462b6ac]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3159ac-21db-4755-bc75-00bdc9d2d5d6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmfyEwNI {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmfyEwNI" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c441bd-1851-4b4d-922c-1e149921086f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmfyEwNI'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e0a9b-99bb-43f6-92f7-609b72b453a8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d20ed23-1c21-4a4b-ade9-63f0c9a4f576]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:04 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:04 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:04 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:04 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:04 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:04 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --login" returned: 0 in 0.154s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86fd3df-fe0d-4652-9d4b-19e17164a229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260]
Nov 15 01:31:04 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260] successful.
Nov 15 01:31:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[499e9ed7-67c3-4f7f-bb71-0e3c62c44cb1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4f5fa9-6c84-48d8-b20b-0e2b52047008]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed (non-flash)
Nov 15 01:31:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:05 user nova-compute[74880]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed (non-flash)
Nov 15 01:31:05 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96d873-6bda-443c-91ca-422d82625894]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:31:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmfyEwNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23638366236323436', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638366236323436', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG nova.objects.instance [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:31:06 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:31:06 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:31:06 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:31:06 user nova-compute[74880]:   <serial>c6e02c49-608d-4c5f-806e-9a6c8ea85eed</serial>
Nov 15 01:31:06 user nova-compute[74880]: </disk>
Nov 15 01:31:06 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No VIF found with MAC fa:16:3e:cf:05:d9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:31:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fd479297-9eb0-4c12-b07b-cf9808674a8c tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.645s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:09 user nova-compute[74880]: INFO nova.compute.manager [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Detaching volume c6e02c49-608d-4c5f-806e-9a6c8ea85eed
Nov 15 01:31:09 user nova-compute[74880]: INFO nova.virt.block_device [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attempting to driver detach volume c6e02c49-608d-4c5f-806e-9a6c8ea85eed from mountpoint /dev/vdb
Nov 15 01:31:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Attempting to detach device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:31:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:31:09 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:31:09 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:31:09 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:31:09 user nova-compute[74880]:   <serial>c6e02c49-608d-4c5f-806e-9a6c8ea85eed</serial>
Nov 15 01:31:09 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:31:09 user nova-compute[74880]: </disk>
Nov 15 01:31:09 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:31:09 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config.
Nov 15 01:31:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:31:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:31:09 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:31:09 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:31:09 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:31:09 user nova-compute[74880]:   <serial>c6e02c49-608d-4c5f-806e-9a6c8ea85eed</serial>
Nov 15 01:31:09 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:31:09 user nova-compute[74880]: </disk>
Nov 15 01:31:09 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:31:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:31:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquired lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'info_cache' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Releasing lock "refresh_cache-395fbdae-60fb-4d53-a8b5-731eb60a1c18" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:22 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance destroyed successfully.
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'resources' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG os_vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867c6194-56, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26e8f352-972a-4b05-9d4a-a84b17bfd020) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:22 user nova-compute[74880]: INFO os_vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56')
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start _get_guest_xml network_info=[{"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'numa_topology' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'vcpu_model' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'pci_devices' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:31:23 user nova-compute[74880]:   <uuid>395fbdae-60fb-4d53-a8b5-731eb60a1c18</uuid>
Nov 15 01:31:23 user nova-compute[74880]:   <name>instance-0000001b</name>
Nov 15 01:31:23 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:31:23 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:31:23 user nova-compute[74880]:   <metadata>
Nov 15 01:31:23 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:31:23 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:31:23 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeTestJSON-server-944524409</nova:name>
Nov 15 01:31:23 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:31:23</nova:creationTime>
Nov 15 01:31:23 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:31:23 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:31:23 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:31:23 user nova-compute[74880]:       <nova:owner>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:user uuid="66ea86fccfa749a6a52ac67af682af26">tempest-AttachVolumeTestJSON-1609488545-project-member</nova:user>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:project uuid="0ad971c8d358435095c37d13aac7a30c">tempest-AttachVolumeTestJSON-1609488545</nova:project>
Nov 15 01:31:23 user nova-compute[74880]:       </nova:owner>
Nov 15 01:31:23 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:31:23 user nova-compute[74880]:       <nova:ports>
Nov 15 01:31:23 user nova-compute[74880]:         <nova:port uuid="867c6194-568e-45ef-8222-558e115db573">
Nov 15 01:31:23 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:31:23 user nova-compute[74880]:         </nova:port>
Nov 15 01:31:23 user nova-compute[74880]:       </nova:ports>
Nov 15 01:31:23 user nova-compute[74880]:     </nova:instance>
Nov 15 01:31:23 user nova-compute[74880]:   </metadata>
Nov 15 01:31:23 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:31:23 user nova-compute[74880]:     <system>
Nov 15 01:31:23 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:31:23 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:31:23 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:31:23 user nova-compute[74880]:       <entry name="serial">395fbdae-60fb-4d53-a8b5-731eb60a1c18</entry>
Nov 15 01:31:23 user nova-compute[74880]:       <entry name="uuid">395fbdae-60fb-4d53-a8b5-731eb60a1c18</entry>
Nov 15 01:31:23 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:31:23 user nova-compute[74880]:     </system>
Nov 15 01:31:23 user nova-compute[74880]:   </sysinfo>
Nov 15 01:31:23 user nova-compute[74880]:   <os>
Nov 15 01:31:23 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:31:23 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:31:23 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:31:23 user nova-compute[74880]:   </os>
Nov 15 01:31:23 user nova-compute[74880]:   <features>
Nov 15 01:31:23 user nova-compute[74880]:     <acpi/>
Nov 15 01:31:23 user nova-compute[74880]:     <apic/>
Nov 15 01:31:23 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:31:23 user nova-compute[74880]:   </features>
Nov 15 01:31:23 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:31:23 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:31:23 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:31:23 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:31:23 user nova-compute[74880]:   </clock>
Nov 15 01:31:23 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:31:23 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:31:23 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:31:23 user nova-compute[74880]:   </cpu>
Nov 15 01:31:23 user nova-compute[74880]:   <devices>
Nov 15 01:31:23 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:31:23 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:31:23 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk"/>
Nov 15 01:31:23 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:31:23 user nova-compute[74880]:     </disk>
Nov 15 01:31:23 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:31:23 user nova-compute[74880]:       <mac address="fa:16:3e:45:24:9c"/>
Nov 15 01:31:23 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:31:23 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:31:23 user nova-compute[74880]:       <target dev="tap867c6194-56"/>
Nov 15 01:31:23 user nova-compute[74880]:     </interface>
Nov 15 01:31:23 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:31:23 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/console.log" append="off"/>
Nov 15 01:31:23 user nova-compute[74880]:     </serial>
Nov 15 01:31:23 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:31:23 user nova-compute[74880]:     <video>
Nov 15 01:31:23 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:31:23 user nova-compute[74880]:     </video>
Nov 15 01:31:23 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:31:23 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:31:23 user nova-compute[74880]:     </rng>
Nov 15 01:31:23 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:31:23 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:31:23 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:31:23 user nova-compute[74880]:     </memballoon>
Nov 15 01:31:23 user nova-compute[74880]:   </devices>
Nov 15 01:31:23 user nova-compute[74880]: </domain>
Nov 15 01:31:23 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'trusted_certs' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Cannot resize image /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'migration_context' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.objects.base [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Object Instance<395fbdae-60fb-4d53-a8b5-731eb60a1c18> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG os_vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f417a383-8e31-5e95-95c7-cb0ea81efca9', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867c6194-56, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867c6194-56, col_values=(('qos', UUID('a0098f2f-c2d6-4595-a72d-da6a37b67b12')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867c6194-56, col_values=(('external_ids', {'iface-id': '867c6194-568e-45ef-8222-558e115db573', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:24:9c', 'vm-uuid': '395fbdae-60fb-4d53-a8b5-731eb60a1c18'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:23 user nova-compute[74880]: INFO os_vif [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56')
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-d9ba8fd4-09b7-473e-9e1f-4036bcc6ba17 req-c446fa44-fa55-4c05-9580-69a2462ddd42 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d9ba8fd4-09b7-473e-9e1f-4036bcc6ba17 req-c446fa44-fa55-4c05-9580-69a2462ddd42 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d9ba8fd4-09b7-473e-9e1f-4036bcc6ba17 req-c446fa44-fa55-4c05-9580-69a2462ddd42 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d9ba8fd4-09b7-473e-9e1f-4036bcc6ba17 req-c446fa44-fa55-4c05-9580-69a2462ddd42 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-d9ba8fd4-09b7-473e-9e1f-4036bcc6ba17 req-c446fa44-fa55-4c05-9580-69a2462ddd42 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:25 user nova-compute[74880]: WARNING nova.compute.manager [req-d9ba8fd4-09b7-473e-9e1f-4036bcc6ba17 req-c446fa44-fa55-4c05-9580-69a2462ddd42 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state stopped and task_state powering-on.
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:31:27 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance rebooted successfully.
Nov 15 01:31:27 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0f6aca65-b8bb-48b6-b58d-3fae8fc4d076 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-36d90441-4d7a-48b7-96ac-42520117ae40 req-86ecfd16-ec1b-4f2e-a2bf-85812f7d5d8f service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-36d90441-4d7a-48b7-96ac-42520117ae40 req-86ecfd16-ec1b-4f2e-a2bf-85812f7d5d8f service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-36d90441-4d7a-48b7-96ac-42520117ae40 req-86ecfd16-ec1b-4f2e-a2bf-85812f7d5d8f service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-36d90441-4d7a-48b7-96ac-42520117ae40 req-86ecfd16-ec1b-4f2e-a2bf-85812f7d5d8f service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-36d90441-4d7a-48b7-96ac-42520117ae40 req-86ecfd16-ec1b-4f2e-a2bf-85812f7d5d8f service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:27 user nova-compute[74880]: WARNING nova.compute.manager [req-36d90441-4d7a-48b7-96ac-42520117ae40 req-86ecfd16-ec1b-4f2e-a2bf-85812f7d5d8f service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state stopped and task_state powering-on.
Nov 15 01:31:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-changed-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.compute.manager [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Refreshing instance network info cache due to event network-changed-94995e36-96d0-4fe6-9b98-2394ecac9544. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] Acquiring lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] Acquired lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Refreshing network info cache for port 94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:31:29 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 is timed out.
Nov 15 01:31:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config.
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmfyEwNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:31:29 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c889019c-c7ad-45da-8965-7915594b6e8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:31:29 user nova-compute[74880]: No targets found.
Nov 15 01:31:29 user nova-compute[74880]: iSNS:
Nov 15 01:31:29 user nova-compute[74880]: No targets found.
Nov 15 01:31:29 user nova-compute[74880]: STATIC:
Nov 15 01:31:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871
Nov 15 01:31:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed
Nov 15 01:31:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:31:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:31:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:31:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:29 user nova-compute[74880]: FIRMWARE:
Nov 15 01:31:29 user nova-compute[74880]: No targets found.
Nov 15 01:31:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:31:29 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:31:29 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5a1448-40d7-4d80-b49d-cfe02c596434]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b5b25f-11d5-4ec1-a449-92f7a6bf0d83]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed (non-flash)
Nov 15 01:31:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:29 user nova-compute[74880]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed (non-flash)
Nov 15 01:31:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f95138255a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e178024f-63c1-4d3c-99d7-8ab19f0225b6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb261191-eeb3-4f8a-9527-7dc72152dcd2]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab2da4-f48a-41e9-9407-3b4db7c53924]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f242a12-41b8-445b-9305-502b12ebcc02]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updated VIF entry in instance network info cache for port 94995e36-96d0-4fe6-9b98-2394ecac9544. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.network.neutron [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updating instance_info_cache with network_info: [{"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f8e4ec-434d-464d-86bf-a0936d4fba2b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-896c7656-6526-45c4-8c76-12a5afa1c9b3 req-09dc8fd1-dad7-4fb2-9daf-7fccb5f3f57b service nova] Releasing lock "refresh_cache-0f32696b-c386-48d2-aa46-9801f5356bfb" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fc3cb-9691-46f1-b4ac-549686aa563f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260]
Nov 15 01:31:29 user nova-compute[74880]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed, portal: 172.16.0.220,3260] successful.
Nov 15 01:31:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6e02c49-608d-4c5f-806e-9a6c8ea85eed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2c4c40-a137-466a-b623-0973a705e173]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== disconnect_volume: return (383ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:31:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:31:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d9b9f238-8e20-4002-a80b-a0b8befbee09 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.100s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:31:35 user nova-compute[74880]: INFO nova.compute.claims [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Claim successful on node user
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:31:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.network.neutron [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:31:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:31:36 user nova-compute[74880]: INFO nova.virt.block_device [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Booting with volume snapshot 67542b29-d34c-4b62-8433-aa28d8329868 at /dev/vda
Nov 15 01:31:36 user nova-compute[74880]: DEBUG nova.policy [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '484f6e472b2c4cb588dfab3cc9d3932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c2385409b4f5080bf3d81430ddbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:31:36 user nova-compute[74880]: DEBUG nova.network.neutron [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Successfully created port: f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Successfully updated port: f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquired lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-changed-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Refreshing instance network info cache due to event network-changed-f87822e2-60ae-4497-b2cd-492efe32805a. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] Acquiring lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG nova.network.neutron [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updating instance_info_cache with network_info: [{"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Releasing lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Instance network_info: |[{"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] Acquired lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Refreshing network info cache for port f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updated VIF entry in instance network info cache for port f87822e2-60ae-4497-b2cd-492efe32805a. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updating instance_info_cache with network_info: [{"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d0c42c70-14b5-486a-a004-a80b47d9b466 req-80f61353-f2b6-4c2f-8ddd-e482d10be1bc service nova] Releasing lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:31:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:39 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:31:39 user nova-compute[74880]: INFO nova.compute.claims [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Claim successful on node user
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:31:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.policy [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd34159a5cea6426f8e4303dbf20a99af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cac8f31694b1abcac7d3cfaac76ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:31:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Creating image(s)
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "/opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk 1073741824" returned: 0 in 0.081s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Successfully created port: 88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Cannot resize image /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Ensure instance console log exists: /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG os_brick.utils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54bb863-bec4-4de2-8b18-2c440ddaf4ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Successfully updated port: 88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6e350-d7f4-449b-a1fa-3fc5287fe712]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa91b883-313a-4b95-a0a0-1ac7ac088440]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2858ee39-fe65-4b3d-9659-8647dc01950c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-changed-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Refreshing instance network info cache due to event network-changed-88e605e7-06ac-498d-9ba9-6432b781d68d. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] Acquiring lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-changed-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Refreshing instance network info cache due to event network-changed-db1e3afe-4fae-43c5-b13a-86ad392e2e3e. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] Acquiring lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] Acquired lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.network.neutron [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Refreshing network info cache for port db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:31:42 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:31:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[591af0e9-ef4b-4dec-b73c-574def39b1b6]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG os_brick.utils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:31:42 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updating existing volume attachment record: 104fde2c-44a3-4ebe-9231-b445fdca8491 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updating instance_info_cache with network_info: [{"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Instance network_info: |[{"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] Acquired lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.neutron [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Refreshing network info cache for port 88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Start _get_guest_xml network_info=[{"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:31:43 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:43 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-57320980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-57320980',id=39,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-yds9mxx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:31:41Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=9beee7a8-c7eb-45bd-8080-a802365f0029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'pci_devices' on Instance uuid 9beee7a8-c7eb-45bd-8080-a802365f0029 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:31:43 user nova-compute[74880]:   <uuid>9beee7a8-c7eb-45bd-8080-a802365f0029</uuid>
Nov 15 01:31:43 user nova-compute[74880]:   <name>instance-00000027</name>
Nov 15 01:31:43 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:31:43 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:31:43 user nova-compute[74880]:   <metadata>
Nov 15 01:31:43 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:31:43 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:31:43 user nova-compute[74880]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-57320980</nova:name>
Nov 15 01:31:43 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:31:43</nova:creationTime>
Nov 15 01:31:43 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:31:43 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:31:43 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:31:43 user nova-compute[74880]:       <nova:owner>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:user uuid="d34159a5cea6426f8e4303dbf20a99af">tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member</nova:user>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:project uuid="069cac8f31694b1abcac7d3cfaac76ed">tempest-ServerBootFromVolumeStableRescueTest-330586401</nova:project>
Nov 15 01:31:43 user nova-compute[74880]:       </nova:owner>
Nov 15 01:31:43 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:31:43 user nova-compute[74880]:       <nova:ports>
Nov 15 01:31:43 user nova-compute[74880]:         <nova:port uuid="88e605e7-06ac-498d-9ba9-6432b781d68d">
Nov 15 01:31:43 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:31:43 user nova-compute[74880]:         </nova:port>
Nov 15 01:31:43 user nova-compute[74880]:       </nova:ports>
Nov 15 01:31:43 user nova-compute[74880]:     </nova:instance>
Nov 15 01:31:43 user nova-compute[74880]:   </metadata>
Nov 15 01:31:43 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:31:43 user nova-compute[74880]:     <system>
Nov 15 01:31:43 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:31:43 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:31:43 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:31:43 user nova-compute[74880]:       <entry name="serial">9beee7a8-c7eb-45bd-8080-a802365f0029</entry>
Nov 15 01:31:43 user nova-compute[74880]:       <entry name="uuid">9beee7a8-c7eb-45bd-8080-a802365f0029</entry>
Nov 15 01:31:43 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:31:43 user nova-compute[74880]:     </system>
Nov 15 01:31:43 user nova-compute[74880]:   </sysinfo>
Nov 15 01:31:43 user nova-compute[74880]:   <os>
Nov 15 01:31:43 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:31:43 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:31:43 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:31:43 user nova-compute[74880]:   </os>
Nov 15 01:31:43 user nova-compute[74880]:   <features>
Nov 15 01:31:43 user nova-compute[74880]:     <acpi/>
Nov 15 01:31:43 user nova-compute[74880]:     <apic/>
Nov 15 01:31:43 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:31:43 user nova-compute[74880]:   </features>
Nov 15 01:31:43 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:31:43 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:31:43 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:31:43 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:31:43 user nova-compute[74880]:   </clock>
Nov 15 01:31:43 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:31:43 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:31:43 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:31:43 user nova-compute[74880]:   </cpu>
Nov 15 01:31:43 user nova-compute[74880]:   <devices>
Nov 15 01:31:43 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:31:43 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:31:43 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk"/>
Nov 15 01:31:43 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:31:43 user nova-compute[74880]:     </disk>
Nov 15 01:31:43 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:31:43 user nova-compute[74880]:       <mac address="fa:16:3e:c6:a2:ce"/>
Nov 15 01:31:43 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:31:43 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:31:43 user nova-compute[74880]:       <target dev="tap88e605e7-06"/>
Nov 15 01:31:43 user nova-compute[74880]:     </interface>
Nov 15 01:31:43 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:31:43 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/console.log" append="off"/>
Nov 15 01:31:43 user nova-compute[74880]:     </serial>
Nov 15 01:31:43 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:31:43 user nova-compute[74880]:     <video>
Nov 15 01:31:43 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:31:43 user nova-compute[74880]:     </video>
Nov 15 01:31:43 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:31:43 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:31:43 user nova-compute[74880]:     </rng>
Nov 15 01:31:43 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:31:43 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:31:43 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:31:43 user nova-compute[74880]:     </memballoon>
Nov 15 01:31:43 user nova-compute[74880]:   </devices>
Nov 15 01:31:43 user nova-compute[74880]: </domain>
Nov 15 01:31:43 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-57320980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-57320980',id=39,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-yds9mxx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:31:41Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=9beee7a8-c7eb-45bd-8080-a802365f0029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG os_vif [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '218268b1-9cc7-5893-a769-cc1a2575efe1', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88e605e7-06, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88e605e7-06, col_values=(('qos', UUID('cbd237f3-fa7f-4118-85a5-91f20665de5f')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88e605e7-06, col_values=(('external_ids', {'iface-id': '88e605e7-06ac-498d-9ba9-6432b781d68d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:a2:ce', 'vm-uuid': '9beee7a8-c7eb-45bd-8080-a802365f0029'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:43 user nova-compute[74880]: INFO os_vif [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06')
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No VIF found with MAC fa:16:3e:c6:a2:ce, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.neutron [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Updated VIF entry in instance network info cache for port db1e3afe-4fae-43c5-b13a-86ad392e2e3e. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.neutron [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Updating instance_info_cache with network_info: [{"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-46985d72-32c0-4438-bacd-74db68c9766c req-c141bdb2-97ce-4fc2-98ce-727935bf7f05 service nova] Releasing lock "refresh_cache-8006f0c9-454b-459e-8711-205b0c2d5a62" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.neutron [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updated VIF entry in instance network info cache for port 88e605e7-06ac-498d-9ba9-6432b781d68d. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.network.neutron [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updating instance_info_cache with network_info: [{"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9b59751b-c2cc-4ed6-aa52-3bc4a5e420f4 req-fe42b626-97e5-4ee1-9d0d-d24808fa6aab service nova] Releasing lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:43 user nova-compute[74880]: INFO nova.compute.manager [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Terminating instance
Nov 15 01:31:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d3559d5-9c35-4bb5-b6e2-3d7d66885082 req-f712d50c-68e3-42c7-aeda-afb2ec3d0506 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-vif-unplugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d3559d5-9c35-4bb5-b6e2-3d7d66885082 req-f712d50c-68e3-42c7-aeda-afb2ec3d0506 service nova] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d3559d5-9c35-4bb5-b6e2-3d7d66885082 req-f712d50c-68e3-42c7-aeda-afb2ec3d0506 service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d3559d5-9c35-4bb5-b6e2-3d7d66885082 req-f712d50c-68e3-42c7-aeda-afb2ec3d0506 service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d3559d5-9c35-4bb5-b6e2-3d7d66885082 req-f712d50c-68e3-42c7-aeda-afb2ec3d0506 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] No waiting events found dispatching network-vif-unplugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d3559d5-9c35-4bb5-b6e2-3d7d66885082 req-f712d50c-68e3-42c7-aeda-afb2ec3d0506 service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-vif-unplugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:31:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Instance destroyed successfully.
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'resources' on Instance uuid 8006f0c9-454b-459e-8711-205b0c2d5a62 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-80908015',display_name='tempest-AttachVolumeNegativeTest-server-80908015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-80908015',id=37,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpIYys8tO+w4z7ZMXvJ5hnu9K+JeX5k4JIzWQI8KhuhboxnKTbltqyOsXkUb40hr+jBYlU6vCSv1xSZsGaWEK0gCR1Ya60Ywc1EA+WoO2TzwfvWL/ULugcF/nMz0SWtsQ==',key_name='tempest-keypair-298967234',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-3ke4pe23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=8006f0c9-454b-459e-8711-205b0c2d5a62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "address": "fa:16:3e:1f:23:68", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb1e3afe-4f", "ovs_interfaceid": "db1e3afe-4fae-43c5-b13a-86ad392e2e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG os_vif [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb1e3afe-4f, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0560f26-86d2-49ba-a6e7-c17dc5464313) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:45 user nova-compute[74880]: INFO os_vif [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:23:68,bridge_name='br-int',has_traffic_filtering=True,id=db1e3afe-4fae-43c5-b13a-86ad392e2e3e,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb1e3afe-4f')
Nov 15 01:31:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Deleting instance files /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62_del
Nov 15 01:31:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Deletion of /opt/stack/data/nova/instances/8006f0c9-454b-459e-8711-205b0c2d5a62_del complete
Nov 15 01:31:45 user nova-compute[74880]: INFO nova.compute.manager [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 15 01:31:45 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-bc0052d4-d2e2-49e1-9f08-d423f8765d5d req-c832bb2e-19e6-4834-8399-e39d6450bc6d service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bc0052d4-d2e2-49e1-9f08-d423f8765d5d req-c832bb2e-19e6-4834-8399-e39d6450bc6d service nova] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bc0052d4-d2e2-49e1-9f08-d423f8765d5d req-c832bb2e-19e6-4834-8399-e39d6450bc6d service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bc0052d4-d2e2-49e1-9f08-d423f8765d5d req-c832bb2e-19e6-4834-8399-e39d6450bc6d service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-bc0052d4-d2e2-49e1-9f08-d423f8765d5d req-c832bb2e-19e6-4834-8399-e39d6450bc6d service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] No waiting events found dispatching network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:45 user nova-compute[74880]: WARNING nova.compute.manager [req-bc0052d4-d2e2-49e1-9f08-d423f8765d5d req-c832bb2e-19e6-4834-8399-e39d6450bc6d service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received unexpected event network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d for instance with vm_state building and task_state spawning.
Nov 15 01:31:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:46 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Took 0.93 seconds to deallocate network for instance.
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] Acquiring lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] No waiting events found dispatching network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:46 user nova-compute[74880]: WARNING nova.compute.manager [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received unexpected event network-vif-plugged-db1e3afe-4fae-43c5-b13a-86ad392e2e3e for instance with vm_state deleted and task_state None.
Nov 15 01:31:46 user nova-compute[74880]: DEBUG nova.compute.manager [req-d221741d-6a3e-4575-9a11-618ba40827ff req-44998033-103f-43fd-b82e-8dda4daa88ee service nova] [instance: 8006f0c9-454b-459e-8711-205b0c2d5a62] Received event network-vif-deleted-db1e3afe-4fae-43c5-b13a-86ad392e2e3e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:46 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Deleted allocations for instance 8006f0c9-454b-459e-8711-205b0c2d5a62
Nov 15 01:31:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8844ba30-cf5d-4e50-b9bd-521630addbe4 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "8006f0c9-454b-459e-8711-205b0c2d5a62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.138s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:31:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Creating image(s)
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Ensure instance console log exists: /opt/stack/data/nova/instances/207a3fcc-3571-44a6-ac2e-83beecf3f783/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Start _get_guest_xml network_info=[{"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T01:31:31Z,direct_url=<?>,disk_format='qcow2',id=c1a85bd5-f4fe-4d7b-bd1b-596ba7e63835,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-359624282',owner='861c2385409b4f5080bf3d81430ddbf0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T01:31:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udJLBSIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '207a3fcc-3571-44a6-ac2e-83beecf3f783', 'attached_at': '', 'detached_at': '', 'volume_id': '16676ea7-57f1-4a42-8ed5-327f0300bfdc', 'serial': '16676ea7-57f1-4a42-8ed5-327f0300bfdc'}, 'mount_device': '/dev/vda', 'attachment_id': '104fde2c-44a3-4ebe-9231-b445fdca8491', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:31:47 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:47 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T01:31:31Z,direct_url=<?>,disk_format='qcow2',id=c1a85bd5-f4fe-4d7b-bd1b-596ba7e63835,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-359624282',owner='861c2385409b4f5080bf3d81430ddbf0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T01:31:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udJLBSIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:31:47 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:31:47 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:31:47 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b0537a-350e-4619-a98e-6275cae94362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:31:47 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c84dbcd-3961-49a5-b9d2-5dc0a22e0b93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc] added
Nov 15 01:31:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeebfd22-6013-4b48-9b43-e4a528a134b1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-65098f75-fa5a-40a2-b6cb-361000c68869 req-0b121862-72c0-4fab-a15f-e2d47bf7f643 service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-65098f75-fa5a-40a2-b6cb-361000c68869 req-0b121862-72c0-4fab-a15f-e2d47bf7f643 service nova] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-65098f75-fa5a-40a2-b6cb-361000c68869 req-0b121862-72c0-4fab-a15f-e2d47bf7f643 service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-65098f75-fa5a-40a2-b6cb-361000c68869 req-0b121862-72c0-4fab-a15f-e2d47bf7f643 service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-65098f75-fa5a-40a2-b6cb-361000c68869 req-0b121862-72c0-4fab-a15f-e2d47bf7f643 service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] No waiting events found dispatching network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:47 user nova-compute[74880]: WARNING nova.compute.manager [req-65098f75-fa5a-40a2-b6cb-361000c68869 req-0b121862-72c0-4fab-a15f-e2d47bf7f643 service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received unexpected event network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d for instance with vm_state building and task_state spawning.
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3896a22d-10cc-437e-a09a-bc6552feea5e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v udJLBSIm {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v udJLBSIm" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e0e1cf-5e1a-43ce-90cc-8449ad4f5ffe]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'udJLBSIm'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0655d00c-f3d0-4ea0-bd02-5c6374d62e17]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:31:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Instance spawned successfully.
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[df98f695-52eb-42b2-b5c9-8dd631a608b5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[38064599-a414-405a-bae2-fcd971af34f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260]
Nov 15 01:31:47 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260] successful.
Nov 15 01:31:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: INFO nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 15 01:31:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded93a7-6bc6-4585-8b66-6d1ae74c2acb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7292ad2-832c-4796-b333-4f58c59214c7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:31:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:47 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:31:47 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[987cda8d-11e8-4dc2-98de-17fe8bf44322]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:31:47 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udJLBSIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:31:47 user nova-compute[74880]: INFO nova.compute.manager [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Took 7.83 seconds to build instance.
Nov 15 01:31:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0c94cff6-7c0f-43c2-b5e0-b34f8677cb93 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.936s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:48 user nova-compute[74880]: INFO nova.compute.manager [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Terminating instance
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23030663032333565', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030663032333565', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-52012316-e925-4dd7-9b06-a6344b110b37 req-8df665f1-73f0-40ae-98e7-f973ff960641 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-unplugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-52012316-e925-4dd7-9b06-a6344b110b37 req-8df665f1-73f0-40ae-98e7-f973ff960641 service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-52012316-e925-4dd7-9b06-a6344b110b37 req-8df665f1-73f0-40ae-98e7-f973ff960641 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-52012316-e925-4dd7-9b06-a6344b110b37 req-8df665f1-73f0-40ae-98e7-f973ff960641 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-52012316-e925-4dd7-9b06-a6344b110b37 req-8df665f1-73f0-40ae-98e7-f973ff960641 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-unplugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-52012316-e925-4dd7-9b06-a6344b110b37 req-8df665f1-73f0-40ae-98e7-f973ff960641 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-unplugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-748137313',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-748137313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-748137313',id=38,image_ref='c1a85bd5-f4fe-4d7b-bd1b-596ba7e63835',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlVZ99Ui3U5CbS60hun/5CzxWNyhFlbLrB5PFBgC6PCDkRJevFU3Nu61TTuV18TOoEi709DSUBbuv3V/HhRjGdW1kqLYV1eis+RzVhxxt9ZyVgFKCbDvkz5WNnJGA3dug==',key_name='tempest-keypair-1415310383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-t77496lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1434286508',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=207a3fcc-3571-44a6-ac2e-83beecf3f783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.objects.instance [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'pci_devices' on Instance uuid 207a3fcc-3571-44a6-ac2e-83beecf3f783 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:31:48 user nova-compute[74880]:   <uuid>207a3fcc-3571-44a6-ac2e-83beecf3f783</uuid>
Nov 15 01:31:48 user nova-compute[74880]:   <name>instance-00000026</name>
Nov 15 01:31:48 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:31:48 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:31:48 user nova-compute[74880]:   <metadata>
Nov 15 01:31:48 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:31:48 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:31:48 user nova-compute[74880]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-748137313</nova:name>
Nov 15 01:31:48 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:31:47</nova:creationTime>
Nov 15 01:31:48 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:31:48 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:31:48 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:31:48 user nova-compute[74880]:       <nova:owner>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:user uuid="484f6e472b2c4cb588dfab3cc9d3932a">tempest-TestVolumeBootPattern-1434286508-project-member</nova:user>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:project uuid="861c2385409b4f5080bf3d81430ddbf0">tempest-TestVolumeBootPattern-1434286508</nova:project>
Nov 15 01:31:48 user nova-compute[74880]:       </nova:owner>
Nov 15 01:31:48 user nova-compute[74880]:       <nova:root type="image" uuid="c1a85bd5-f4fe-4d7b-bd1b-596ba7e63835"/>
Nov 15 01:31:48 user nova-compute[74880]:       <nova:ports>
Nov 15 01:31:48 user nova-compute[74880]:         <nova:port uuid="f87822e2-60ae-4497-b2cd-492efe32805a">
Nov 15 01:31:48 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 01:31:48 user nova-compute[74880]:         </nova:port>
Nov 15 01:31:48 user nova-compute[74880]:       </nova:ports>
Nov 15 01:31:48 user nova-compute[74880]:     </nova:instance>
Nov 15 01:31:48 user nova-compute[74880]:   </metadata>
Nov 15 01:31:48 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:31:48 user nova-compute[74880]:     <system>
Nov 15 01:31:48 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:31:48 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:31:48 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:31:48 user nova-compute[74880]:       <entry name="serial">207a3fcc-3571-44a6-ac2e-83beecf3f783</entry>
Nov 15 01:31:48 user nova-compute[74880]:       <entry name="uuid">207a3fcc-3571-44a6-ac2e-83beecf3f783</entry>
Nov 15 01:31:48 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:31:48 user nova-compute[74880]:     </system>
Nov 15 01:31:48 user nova-compute[74880]:   </sysinfo>
Nov 15 01:31:48 user nova-compute[74880]:   <os>
Nov 15 01:31:48 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:31:48 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:31:48 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:31:48 user nova-compute[74880]:   </os>
Nov 15 01:31:48 user nova-compute[74880]:   <features>
Nov 15 01:31:48 user nova-compute[74880]:     <acpi/>
Nov 15 01:31:48 user nova-compute[74880]:     <apic/>
Nov 15 01:31:48 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:31:48 user nova-compute[74880]:   </features>
Nov 15 01:31:48 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:31:48 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:31:48 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:31:48 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:31:48 user nova-compute[74880]:   </clock>
Nov 15 01:31:48 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:31:48 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:31:48 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:31:48 user nova-compute[74880]:   </cpu>
Nov 15 01:31:48 user nova-compute[74880]:   <devices>
Nov 15 01:31:48 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:31:48 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:31:48 user nova-compute[74880]:       <source dev="/dev/sdf"/>
Nov 15 01:31:48 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:31:48 user nova-compute[74880]:       <serial>16676ea7-57f1-4a42-8ed5-327f0300bfdc</serial>
Nov 15 01:31:48 user nova-compute[74880]:     </disk>
Nov 15 01:31:48 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:31:48 user nova-compute[74880]:       <mac address="fa:16:3e:58:25:6e"/>
Nov 15 01:31:48 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:31:48 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:31:48 user nova-compute[74880]:       <target dev="tapf87822e2-60"/>
Nov 15 01:31:48 user nova-compute[74880]:     </interface>
Nov 15 01:31:48 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:31:48 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/207a3fcc-3571-44a6-ac2e-83beecf3f783/console.log" append="off"/>
Nov 15 01:31:48 user nova-compute[74880]:     </serial>
Nov 15 01:31:48 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:31:48 user nova-compute[74880]:     <video>
Nov 15 01:31:48 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:31:48 user nova-compute[74880]:     </video>
Nov 15 01:31:48 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:31:48 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:31:48 user nova-compute[74880]:     </rng>
Nov 15 01:31:48 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:31:48 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:31:48 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:31:48 user nova-compute[74880]:     </memballoon>
Nov 15 01:31:48 user nova-compute[74880]:   </devices>
Nov 15 01:31:48 user nova-compute[74880]: </domain>
Nov 15 01:31:48 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-748137313',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-748137313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-748137313',id=38,image_ref='c1a85bd5-f4fe-4d7b-bd1b-596ba7e63835',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlVZ99Ui3U5CbS60hun/5CzxWNyhFlbLrB5PFBgC6PCDkRJevFU3Nu61TTuV18TOoEi709DSUBbuv3V/HhRjGdW1kqLYV1eis+RzVhxxt9ZyVgFKCbDvkz5WNnJGA3dug==',key_name='tempest-keypair-1415310383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-t77496lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1434286508',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=207a3fcc-3571-44a6-ac2e-83beecf3f783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG os_vif [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c33738a8-8d8a-51b2-9b15-129286aae5d3', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf87822e2-60, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf87822e2-60, col_values=(('qos', UUID('28ef33e4-08a1-4274-9c77-a57839270d9f')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf87822e2-60, col_values=(('external_ids', {'iface-id': 'f87822e2-60ae-4497-b2cd-492efe32805a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:25:6e', 'vm-uuid': '207a3fcc-3571-44a6-ac2e-83beecf3f783'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:48 user nova-compute[74880]: INFO os_vif [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60')
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:31:48 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No VIF found with MAC fa:16:3e:58:25:6e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:31:50 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Instance destroyed successfully.
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'resources' on Instance uuid b73970f1-764f-46ed-a25a-b5418a91b17b {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-748895696',display_name='tempest-ServerActionsTestOtherA-server-748895696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-748895696',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-e3ryz9gr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=b73970f1-764f-46ed-a25a-b5418a91b17b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "address": "fa:16:3e:c8:3d:0a", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64bd0957-7c", "ovs_interfaceid": "64bd0957-7c1f-4660-b3ff-2445d6af85d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_vif [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64bd0957-7c, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec6bf166-0aaa-4cc7-bc1f-521ed4319456) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: INFO os_vif [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:3d:0a,bridge_name='br-int',has_traffic_filtering=True,id=64bd0957-7c1f-4660-b3ff-2445d6af85d6,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64bd0957-7c')
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFQZlLof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:31:50 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67933913-405e-4e8b-b128-0906c6ef7033]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:31:50 user nova-compute[74880]: No targets found.
Nov 15 01:31:50 user nova-compute[74880]: iSNS:
Nov 15 01:31:50 user nova-compute[74880]: No targets found.
Nov 15 01:31:50 user nova-compute[74880]: STATIC:
Nov 15 01:31:50 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871
Nov 15 01:31:50 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:50 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:50 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:31:50 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:50 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:50 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc
Nov 15 01:31:50 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:50 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:50 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:31:50 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:50 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:50 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef
Nov 15 01:31:50 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:31:50 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:31:50 user nova-compute[74880]: FIRMWARE:
Nov 15 01:31:50 user nova-compute[74880]: No targets found.
Nov 15 01:31:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:31:50 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:31:50 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d32f18f-2fd6-4487-8d20-f54fd0d7e9ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe75ff83-84b0-4b75-8ee1-bd95b672402d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:31:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:31:50 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:31:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01d9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd336a-a9be-48d2-9fb8-5d7b7980a169]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e146c3-bf20-4f4b-b49a-f6b91e2a46f5]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f2ac25-f2d4-412d-8316-05fbee14033f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.090s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c74681-9530-45f2-907d-b02ca0e80d75]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2434959-b122-4e2f-b7cd-2930f961ddb8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b000a6-cffd-40bb-ba5c-d4a892125695]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260]
Nov 15 01:31:50 user nova-compute[74880]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef, portal: 172.16.0.220,3260] successful.
Nov 15 01:31:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7397a78f-439d-4d7e-8175-2518aef395ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a2068-955d-44e8-b722-49932b4a0766]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] <== disconnect_volume: return (403ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:31:50 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Deleting instance files /opt/stack/data/nova/instances/b73970f1-764f-46ed-a25a-b5418a91b17b_del
Nov 15 01:31:50 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Deletion of /opt/stack/data/nova/instances/b73970f1-764f-46ed-a25a-b5418a91b17b_del complete
Nov 15 01:31:50 user nova-compute[74880]: INFO nova.compute.manager [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Took 2.26 seconds to destroy the instance on the hypervisor.
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-aad2e405-408e-49f5-b465-b9609ee1fe0f req-9cccd0d9-acbd-489d-916d-9e6a1e58af29 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aad2e405-408e-49f5-b465-b9609ee1fe0f req-9cccd0d9-acbd-489d-916d-9e6a1e58af29 service nova] Acquiring lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aad2e405-408e-49f5-b465-b9609ee1fe0f req-9cccd0d9-acbd-489d-916d-9e6a1e58af29 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-aad2e405-408e-49f5-b465-b9609ee1fe0f req-9cccd0d9-acbd-489d-916d-9e6a1e58af29 service nova] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-aad2e405-408e-49f5-b465-b9609ee1fe0f req-9cccd0d9-acbd-489d-916d-9e6a1e58af29 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] No waiting events found dispatching network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:50 user nova-compute[74880]: WARNING nova.compute.manager [req-aad2e405-408e-49f5-b465-b9609ee1fe0f req-9cccd0d9-acbd-489d-916d-9e6a1e58af29 service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received unexpected event network-vif-plugged-64bd0957-7c1f-4660-b3ff-2445d6af85d6 for instance with vm_state active and task_state deleting.
Nov 15 01:31:51 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:51 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Took 0.87 seconds to deallocate network for instance.
Nov 15 01:31:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-fc05fab3-e14c-46cf-9ba7-8e63ad6b25bd req-4e2afaca-95b5-464f-a135-68537099986d service nova] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Received event network-vif-deleted-64bd0957-7c1f-4660-b3ff-2445d6af85d6 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:51 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:51 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:51 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:52 user nova-compute[74880]: INFO nova.compute.manager [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Took 0.80 seconds to detach 1 volumes for instance.
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: b73970f1-764f-46ed-a25a-b5418a91b17b] Deleting volume: 7397a78f-439d-4d7e-8175-2518aef395ef {{(pid=74880) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:31:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Instance spawned successfully.
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:31:52 user nova-compute[74880]: INFO nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:52 user nova-compute[74880]: INFO nova.compute.manager [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Took 17.34 seconds to build instance.
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-803176f0-9536-409d-bfc9-5e7209330479 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.480s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.113s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:31:52 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Deleted allocations for instance b73970f1-764f-46ed-a25a-b5418a91b17b
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] No waiting events found dispatching network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:52 user nova-compute[74880]: WARNING nova.compute.manager [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received unexpected event network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a for instance with vm_state active and task_state None.
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] No waiting events found dispatching network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:31:52 user nova-compute[74880]: WARNING nova.compute.manager [req-a0eb8084-90bc-4dd1-aad0-db13040cf015 req-dbf6081e-2da0-437a-b5dd-2f4af33c0526 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received unexpected event network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a for instance with vm_state active and task_state None.
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0f3b476e-5b7c-4d9d-90b5-5a97666fa724 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "b73970f1-764f-46ed-a25a-b5418a91b17b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.750s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:31:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:31:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8102MB free_disk=25.3126220703125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f4c1939c-4166-41e1-a915-af269583b53a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0f32696b-c386-48d2-aa46-9801f5356bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 207a3fcc-3571-44a6-ac2e-83beecf3f783 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:31:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:31:57 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [{"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:31:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "ca343268-f1e1-4474-95b1-338040b48523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:31:59 user nova-compute[74880]: INFO nova.compute.claims [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Claim successful on node user
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:31:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:31:59 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:32:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG nova.policy [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac6c01f42dc4068bf96be9e8572628d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646d3218ee4f4bf9809ae94da0dbd521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:32:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Creating image(s)
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "/opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "/opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk 1073741824" returned: 0 in 0.065s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Successfully created port: 94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.234s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:32:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Cannot resize image /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Ensure instance console log exists: /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Successfully updated port: 94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "refresh_cache-ca343268-f1e1-4474-95b1-338040b48523" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquired lock "refresh_cache-ca343268-f1e1-4474-95b1-338040b48523" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-changed-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.compute.manager [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Refreshing instance network info cache due to event network-changed-94870612-7775-49eb-9b23-08dac5f78301. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] Acquiring lock "refresh_cache-ca343268-f1e1-4474-95b1-338040b48523" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Updating instance_info_cache with network_info: [{"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Releasing lock "refresh_cache-ca343268-f1e1-4474-95b1-338040b48523" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Instance network_info: |[{"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] Acquired lock "refresh_cache-ca343268-f1e1-4474-95b1-338040b48523" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.neutron [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Refreshing network info cache for port 94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Start _get_guest_xml network_info=[{"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:32:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:32:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772726477',display_name='tempest-VolumesActionsTest-instance-1772726477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772726477',id=40,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='646d3218ee4f4bf9809ae94da0dbd521',ramdisk_id='',reservation_id='r-j88doep9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-600661337',owner_user_name='tempest-VolumesActionsTest-600661337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:32:00Z,user_data=None,user_id='fac6c01f42dc4068bf96be9e8572628d',uuid=ca343268-f1e1-4474-95b1-338040b48523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Converting VIF {"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lazy-loading 'pci_devices' on Instance uuid ca343268-f1e1-4474-95b1-338040b48523 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:32:01 user nova-compute[74880]:   <uuid>ca343268-f1e1-4474-95b1-338040b48523</uuid>
Nov 15 01:32:01 user nova-compute[74880]:   <name>instance-00000028</name>
Nov 15 01:32:01 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:32:01 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:32:01 user nova-compute[74880]:   <metadata>
Nov 15 01:32:01 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:32:01 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:32:01 user nova-compute[74880]:       <nova:name>tempest-VolumesActionsTest-instance-1772726477</nova:name>
Nov 15 01:32:01 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:32:01</nova:creationTime>
Nov 15 01:32:01 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:32:01 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:32:01 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:32:01 user nova-compute[74880]:       <nova:owner>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:user uuid="fac6c01f42dc4068bf96be9e8572628d">tempest-VolumesActionsTest-600661337-project-member</nova:user>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:project uuid="646d3218ee4f4bf9809ae94da0dbd521">tempest-VolumesActionsTest-600661337</nova:project>
Nov 15 01:32:01 user nova-compute[74880]:       </nova:owner>
Nov 15 01:32:01 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:32:01 user nova-compute[74880]:       <nova:ports>
Nov 15 01:32:01 user nova-compute[74880]:         <nova:port uuid="94870612-7775-49eb-9b23-08dac5f78301">
Nov 15 01:32:01 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 01:32:01 user nova-compute[74880]:         </nova:port>
Nov 15 01:32:01 user nova-compute[74880]:       </nova:ports>
Nov 15 01:32:01 user nova-compute[74880]:     </nova:instance>
Nov 15 01:32:01 user nova-compute[74880]:   </metadata>
Nov 15 01:32:01 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:32:01 user nova-compute[74880]:     <system>
Nov 15 01:32:01 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:32:01 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:32:01 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:32:01 user nova-compute[74880]:       <entry name="serial">ca343268-f1e1-4474-95b1-338040b48523</entry>
Nov 15 01:32:01 user nova-compute[74880]:       <entry name="uuid">ca343268-f1e1-4474-95b1-338040b48523</entry>
Nov 15 01:32:01 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:32:01 user nova-compute[74880]:     </system>
Nov 15 01:32:01 user nova-compute[74880]:   </sysinfo>
Nov 15 01:32:01 user nova-compute[74880]:   <os>
Nov 15 01:32:01 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:32:01 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:32:01 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:32:01 user nova-compute[74880]:   </os>
Nov 15 01:32:01 user nova-compute[74880]:   <features>
Nov 15 01:32:01 user nova-compute[74880]:     <acpi/>
Nov 15 01:32:01 user nova-compute[74880]:     <apic/>
Nov 15 01:32:01 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:32:01 user nova-compute[74880]:   </features>
Nov 15 01:32:01 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:32:01 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:32:01 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:32:01 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:32:01 user nova-compute[74880]:   </clock>
Nov 15 01:32:01 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:32:01 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:32:01 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:32:01 user nova-compute[74880]:   </cpu>
Nov 15 01:32:01 user nova-compute[74880]:   <devices>
Nov 15 01:32:01 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:32:01 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:32:01 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk"/>
Nov 15 01:32:01 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:32:01 user nova-compute[74880]:     </disk>
Nov 15 01:32:01 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:32:01 user nova-compute[74880]:       <mac address="fa:16:3e:20:6b:38"/>
Nov 15 01:32:01 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:32:01 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:32:01 user nova-compute[74880]:       <target dev="tap94870612-77"/>
Nov 15 01:32:01 user nova-compute[74880]:     </interface>
Nov 15 01:32:01 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:32:01 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/console.log" append="off"/>
Nov 15 01:32:01 user nova-compute[74880]:     </serial>
Nov 15 01:32:01 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:32:01 user nova-compute[74880]:     <video>
Nov 15 01:32:01 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:32:01 user nova-compute[74880]:     </video>
Nov 15 01:32:01 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:32:01 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:32:01 user nova-compute[74880]:     </rng>
Nov 15 01:32:01 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:32:01 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:32:01 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:32:01 user nova-compute[74880]:     </memballoon>
Nov 15 01:32:01 user nova-compute[74880]:   </devices>
Nov 15 01:32:01 user nova-compute[74880]: </domain>
Nov 15 01:32:01 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772726477',display_name='tempest-VolumesActionsTest-instance-1772726477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772726477',id=40,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='646d3218ee4f4bf9809ae94da0dbd521',ramdisk_id='',reservation_id='r-j88doep9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-600661337',owner_user_name='tempest-VolumesActionsTest-600661337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:32:00Z,user_data=None,user_id='fac6c01f42dc4068bf96be9e8572628d',uuid=ca343268-f1e1-4474-95b1-338040b48523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Converting VIF {"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG os_vif [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ebf6c05-ee64-54ae-9f68-bde1df1e2504', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94870612-77, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94870612-77, col_values=(('qos', UUID('83080b66-65b8-401d-b888-8e4c07cca214')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94870612-77, col_values=(('external_ids', {'iface-id': '94870612-7775-49eb-9b23-08dac5f78301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6b:38', 'vm-uuid': 'ca343268-f1e1-4474-95b1-338040b48523'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:01 user nova-compute[74880]: INFO os_vif [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77')
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:32:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] No VIF found with MAC fa:16:3e:20:6b:38, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Updated VIF entry in instance network info cache for port 94870612-7775-49eb-9b23-08dac5f78301. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG nova.network.neutron [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Updating instance_info_cache with network_info: [{"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-48731cd3-29bb-4903-bbb4-fd00a0afdc21 req-31a03f74-a28b-4730-811f-f103d2710ce9 service nova] Releasing lock "refresh_cache-ca343268-f1e1-4474-95b1-338040b48523" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:02 user nova-compute[74880]: INFO nova.compute.manager [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attaching volume 411ecdd0-2e2a-4bc8-a794-42bdb2081d4b to /dev/vdb
Nov 15 01:32:02 user nova-compute[74880]: DEBUG os_brick.utils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00bd8f0-4581-4eed-ba1a-7e77cd35415b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060c26b-c71f-474f-8581-625566eefd1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852bcba-4a7a-422c-a36b-27d1f675743f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef4493-bcee-48c7-b7df-b1075dd9b449]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:32:02 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:32:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[318457b5-1ba7-48b4-bbb5-1b70290d7978]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG os_brick.utils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:32:02 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating existing volume attachment record: 9a461158-d7d9-4c78-ad51-19015af83570 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:32:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-747e8d8e-afda-43f0-a077-298a2a30cad6 req-faecc62f-9f47-4f42-b315-b8bb62b977c3 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:32:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-747e8d8e-afda-43f0-a077-298a2a30cad6 req-faecc62f-9f47-4f42-b315-b8bb62b977c3 service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-747e8d8e-afda-43f0-a077-298a2a30cad6 req-faecc62f-9f47-4f42-b315-b8bb62b977c3 service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-747e8d8e-afda-43f0-a077-298a2a30cad6 req-faecc62f-9f47-4f42-b315-b8bb62b977c3 service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-747e8d8e-afda-43f0-a077-298a2a30cad6 req-faecc62f-9f47-4f42-b315-b8bb62b977c3 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:32:04 user nova-compute[74880]: WARNING nova.compute.manager [req-747e8d8e-afda-43f0-a077-298a2a30cad6 req-faecc62f-9f47-4f42-b315-b8bb62b977c3 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received unexpected event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with vm_state building and task_state spawning.
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:32:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ca343268-f1e1-4474-95b1-338040b48523] Instance spawned successfully.
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:32:05 user nova-compute[74880]: INFO nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 15 01:32:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:32:05 user nova-compute[74880]: INFO nova.compute.manager [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Took 6.45 seconds to build instance.
Nov 15 01:32:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ae317010-3d02-4ea9-9fa5-e2bc63006a55 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "ca343268-f1e1-4474-95b1-338040b48523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.572s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-75d99112-2ea5-4234-a38d-a17a22c0e02b req-8bbefc3d-9c16-4bd4-a64f-e00148dbc1fa service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:32:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-75d99112-2ea5-4234-a38d-a17a22c0e02b req-8bbefc3d-9c16-4bd4-a64f-e00148dbc1fa service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-75d99112-2ea5-4234-a38d-a17a22c0e02b req-8bbefc3d-9c16-4bd4-a64f-e00148dbc1fa service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-75d99112-2ea5-4234-a38d-a17a22c0e02b req-8bbefc3d-9c16-4bd4-a64f-e00148dbc1fa service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-75d99112-2ea5-4234-a38d-a17a22c0e02b req-8bbefc3d-9c16-4bd4-a64f-e00148dbc1fa service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:32:06 user nova-compute[74880]: WARNING nova.compute.manager [req-75d99112-2ea5-4234-a38d-a17a22c0e02b req-8bbefc3d-9c16-4bd4-a64f-e00148dbc1fa service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received unexpected event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with vm_state active and task_state None.
Nov 15 01:32:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvbMruUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:32:07 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:32:07 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:32:07 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d484af4-9421-4c56-bf82-4a1d49f6136a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:32:07 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808b03e-b974-4684-bf43-6bb404b87bd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b] added
Nov 15 01:32:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2443b0b8-5f59-4dad-923f-d83422fd6391]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc13504f-d93d-44d4-84e6-22d400e3eb3b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AvbMruUq {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AvbMruUq" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea468ca4-3eb6-41a0-b028-0d0edd0cb4e4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AvbMruUq'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fea981-d676-489b-8932-94a15c18afed]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41bfa93-4b05-4357-a4fd-7fba39aeab64]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f70519-fdd3-4a3c-8e1b-97b1ebc864ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260]
Nov 15 01:32:07 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260] successful.
Nov 15 01:32:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9418224c-66ab-4682-ad73-5516c919d046]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a10eb04-b967-41ee-92ea-80fe2bd127c7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b (non-flash)
Nov 15 01:32:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:07 user nova-compute[74880]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b (non-flash)
Nov 15 01:32:07 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[250d601a-3bac-4063-9175-128b55df49b9]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvbMruUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23431616464316463', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431616464316463', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:32:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:32:08 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:32:08 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:32:08 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:32:08 user nova-compute[74880]:   <serial>411ecdd0-2e2a-4bc8-a794-42bdb2081d4b</serial>
Nov 15 01:32:08 user nova-compute[74880]: </disk>
Nov 15 01:32:08 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:32:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:32:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:32:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] No VIF found with MAC fa:16:3e:cf:05:d9, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:32:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8b3b4f96-e44f-4fcb-864f-498fce318ab4 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.831s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:11 user nova-compute[74880]: INFO nova.compute.manager [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Detaching volume 411ecdd0-2e2a-4bc8-a794-42bdb2081d4b
Nov 15 01:32:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:11 user nova-compute[74880]: INFO nova.virt.block_device [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Attempting to driver detach volume 411ecdd0-2e2a-4bc8-a794-42bdb2081d4b from mountpoint /dev/vdb
Nov 15 01:32:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Attempting to detach device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:32:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:32:11 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:32:11 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:32:11 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:32:11 user nova-compute[74880]:   <serial>411ecdd0-2e2a-4bc8-a794-42bdb2081d4b</serial>
Nov 15 01:32:11 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:32:11 user nova-compute[74880]: </disk>
Nov 15 01:32:11 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:32:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the persistent domain config.
Nov 15 01:32:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:32:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:32:11 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:32:11 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:32:11 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:32:11 user nova-compute[74880]:   <serial>411ecdd0-2e2a-4bc8-a794-42bdb2081d4b</serial>
Nov 15 01:32:11 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:32:11 user nova-compute[74880]: </disk>
Nov 15 01:32:11 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:32:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:32:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 is timed out.
Nov 15 01:32:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully detached device vdb from instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 from the live domain config.
Nov 15 01:32:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvbMruUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:32:32 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdb1f48-4caf-4c1d-bed5-429fec5dbdb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:32:32 user nova-compute[74880]: No targets found.
Nov 15 01:32:32 user nova-compute[74880]: iSNS:
Nov 15 01:32:32 user nova-compute[74880]: No targets found.
Nov 15 01:32:32 user nova-compute[74880]: STATIC:
Nov 15 01:32:32 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871
Nov 15 01:32:32 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:32 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:32 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:32:32 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:32 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:32 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc
Nov 15 01:32:32 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:32 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:32 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:32:32 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:32 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:32 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b
Nov 15 01:32:32 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:32 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:32 user nova-compute[74880]: FIRMWARE:
Nov 15 01:32:32 user nova-compute[74880]: No targets found.
Nov 15 01:32:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:32:32 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:32:32 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af626760-b4b5-4e34-9b2c-075e5ce0ecbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e697fc0b-709c-4476-90df-89d40367bab8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b (non-flash)
Nov 15 01:32:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:32 user nova-compute[74880]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b (non-flash)
Nov 15 01:32:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f05ec8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a1166-0f5b-4d34-a21b-35f1d1ef01bc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c786d40c-efde-4067-b35a-13e744f66d6e]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4722013f-849d-467c-9878-9fa0a5acc660]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c2d6fc-5b1f-4bc8-bc89-76a2b0f68364]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9119c16-1854-4b9e-b53e-d3b1e603170f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2470870-0d5d-435f-a0b6-e23091766b9c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260]
Nov 15 01:32:32 user nova-compute[74880]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b, portal: 172.16.0.220,3260] successful.
Nov 15 01:32:32 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:411ecdd0-2e2a-4bc8-a794-42bdb2081d4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad1b84-e58b-411b-999a-fcebd94ca478]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] <== disconnect_volume: return (335ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:32:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:32:33 user nova-compute[74880]: DEBUG nova.objects.instance [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'flavor' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:32:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-824405a6-d986-45d0-8928-c755bfc6ce3a tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:35 user nova-compute[74880]: INFO nova.compute.manager [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Detaching volume 6dbab67f-baee-4604-bcc8-58bf906f9871
Nov 15 01:32:35 user nova-compute[74880]: INFO nova.virt.block_device [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Attempting to driver detach volume 6dbab67f-baee-4604-bcc8-58bf906f9871 from mountpoint /dev/vdb
Nov 15 01:32:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Attempting to detach device vdb from instance f4c1939c-4166-41e1-a915-af269583b53a from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:32:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:32:35 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:32:35 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:32:35 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:32:35 user nova-compute[74880]:   <serial>6dbab67f-baee-4604-bcc8-58bf906f9871</serial>
Nov 15 01:32:35 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:32:35 user nova-compute[74880]: </disk>
Nov 15 01:32:35 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:32:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully detached device vdb from instance f4c1939c-4166-41e1-a915-af269583b53a from the persistent domain config.
Nov 15 01:32:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4c1939c-4166-41e1-a915-af269583b53a from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:32:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:32:35 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:32:35 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:32:35 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:32:35 user nova-compute[74880]:   <serial>6dbab67f-baee-4604-bcc8-58bf906f9871</serial>
Nov 15 01:32:35 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:32:35 user nova-compute[74880]: </disk>
Nov 15 01:32:35 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:32:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:32:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:41 user nova-compute[74880]: INFO nova.compute.manager [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Terminating instance
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-79fdce14-f22f-4b7b-8f98-4ada3db03c8d req-fb043cc4-1135-46e9-bfa5-66bfba66302a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-vif-unplugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-79fdce14-f22f-4b7b-8f98-4ada3db03c8d req-fb043cc4-1135-46e9-bfa5-66bfba66302a service nova] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-79fdce14-f22f-4b7b-8f98-4ada3db03c8d req-fb043cc4-1135-46e9-bfa5-66bfba66302a service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-79fdce14-f22f-4b7b-8f98-4ada3db03c8d req-fb043cc4-1135-46e9-bfa5-66bfba66302a service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-79fdce14-f22f-4b7b-8f98-4ada3db03c8d req-fb043cc4-1135-46e9-bfa5-66bfba66302a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] No waiting events found dispatching network-vif-unplugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-79fdce14-f22f-4b7b-8f98-4ada3db03c8d req-fb043cc4-1135-46e9-bfa5-66bfba66302a service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-vif-unplugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Instance destroyed successfully.
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lazy-loading 'resources' on Instance uuid a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-409451842',display_name='tempest-ServerActionsTestOtherA-server-409451842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-409451842',id=5,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+rebik32osmf6n/LCx0/A9rMIZuawMqlL0vPPTbwl7nLawhnA3BJFYiVt1YzQNSp9txgcVnBBwrqjtiHoPX/khx5QVZv610l/ajDd92AFEz+dnx8G1dImd9b1glHSpJQ==',key_name='tempest-keypair-1832706330',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:14:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3350f1780d5464dae7c3eca61375446',ramdisk_id='',reservation_id='r-1bdbu326',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1659960630',owner_user_name='tempest-ServerActionsTestOtherA-1659960630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0b04e9fd63942fb9279c26ddeec3acc',uuid=a3d02a78-a752-4ca5-ab3b-f45ada7a47e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converting VIF {"id": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "address": "fa:16:3e:de:40:96", "network": {"id": "a6db8241-7cf2-4557-9f04-8a9380ddee69", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2001162957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3350f1780d5464dae7c3eca61375446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4a6925-6a", "ovs_interfaceid": "dc4a6925-6a3f-47fc-a0df-0a77d9f5927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG os_vif [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4a6925-6a, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90b5d62a-a095-43e8-b550-33d0c6aa2f73) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:41 user nova-compute[74880]: INFO os_vif [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:40:96,bridge_name='br-int',has_traffic_filtering=True,id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b,network=Network(a6db8241-7cf2-4557-9f04-8a9380ddee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4a6925-6a')
Nov 15 01:32:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Deleting instance files /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7_del
Nov 15 01:32:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Deletion of /opt/stack/data/nova/instances/a3d02a78-a752-4ca5-ab3b-f45ada7a47e7_del complete
Nov 15 01:32:41 user nova-compute[74880]: INFO nova.compute.manager [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 01:32:41 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:32:41 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:32:42 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Took 0.42 seconds to deallocate network for instance.
Nov 15 01:32:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-ef87c180-9e14-44ac-8c74-926ede85931f req-67a48331-7019-43ec-95e1-6e26faad49ed service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-vif-deleted-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:32:42 user nova-compute[74880]: INFO nova.compute.manager [req-ef87c180-9e14-44ac-8c74-926ede85931f req-67a48331-7019-43ec-95e1-6e26faad49ed service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Neutron deleted interface dc4a6925-6a3f-47fc-a0df-0a77d9f5927b; detaching it from the instance and deleting it from the info cache
Nov 15 01:32:42 user nova-compute[74880]: DEBUG nova.network.neutron [req-ef87c180-9e14-44ac-8c74-926ede85931f req-67a48331-7019-43ec-95e1-6e26faad49ed service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG nova.compute.manager [req-ef87c180-9e14-44ac-8c74-926ede85931f req-67a48331-7019-43ec-95e1-6e26faad49ed service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Detach interface failed, port_id=dc4a6925-6a3f-47fc-a0df-0a77d9f5927b, reason: Instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:32:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:42 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Deleted allocations for instance a3d02a78-a752-4ca5-ab3b-f45ada7a47e7
Nov 15 01:32:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2ad890d0-9dfd-4701-99eb-e697a7a57678 tempest-ServerActionsTestOtherA-1659960630 tempest-ServerActionsTestOtherA-1659960630-project-member] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.835s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-95ef1e94-1638-4004-b615-2bbcfd8ca9bd req-80d0ebff-0cfc-47a7-8223-4c9f0be75b99 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received event network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:32:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95ef1e94-1638-4004-b615-2bbcfd8ca9bd req-80d0ebff-0cfc-47a7-8223-4c9f0be75b99 service nova] Acquiring lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95ef1e94-1638-4004-b615-2bbcfd8ca9bd req-80d0ebff-0cfc-47a7-8223-4c9f0be75b99 service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95ef1e94-1638-4004-b615-2bbcfd8ca9bd req-80d0ebff-0cfc-47a7-8223-4c9f0be75b99 service nova] Lock "a3d02a78-a752-4ca5-ab3b-f45ada7a47e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-95ef1e94-1638-4004-b615-2bbcfd8ca9bd req-80d0ebff-0cfc-47a7-8223-4c9f0be75b99 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] No waiting events found dispatching network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:32:43 user nova-compute[74880]: WARNING nova.compute.manager [req-95ef1e94-1638-4004-b615-2bbcfd8ca9bd req-80d0ebff-0cfc-47a7-8223-4c9f0be75b99 service nova] [instance: a3d02a78-a752-4ca5-ab3b-f45ada7a47e7] Received unexpected event network-vif-plugged-dc4a6925-6a3f-47fc-a0df-0a77d9f5927b for instance with vm_state deleted and task_state None.
Nov 15 01:32:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:51 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:32:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:32:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=7753MB free_disk=25.27410888671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:32:55 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4c1939c-4166-41e1-a915-af269583b53a is timed out.
Nov 15 01:32:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully detached device vdb from instance f4c1939c-4166-41e1-a915-af269583b53a from the live domain config.
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFXDLgxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:32:55 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ec5ce-3daf-4889-a7a3-e6ea2eaf192d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:32:55 user nova-compute[74880]: No targets found.
Nov 15 01:32:55 user nova-compute[74880]: iSNS:
Nov 15 01:32:55 user nova-compute[74880]: No targets found.
Nov 15 01:32:55 user nova-compute[74880]: STATIC:
Nov 15 01:32:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871
Nov 15 01:32:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:32:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc
Nov 15 01:32:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:32:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:32:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:32:55 user nova-compute[74880]: FIRMWARE:
Nov 15 01:32:55 user nova-compute[74880]: No targets found.
Nov 15 01:32:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:32:55 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:32:55 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18555bb-b780-4347-9717-f21aeb56e685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f4c1939c-4166-41e1-a915-af269583b53a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0f32696b-c386-48d2-aa46-9801f5356bfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 207a3fcc-3571-44a6-ac2e-83beecf3f783 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ca343268-f1e1-4474-95b1-338040b48523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f25130-2690-4774-bf17-2b1857934950]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:55 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:55 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:55 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:32:55 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:32:55 user nova-compute[74880]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 (non-flash)
Nov 15 01:32:55 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:32:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f951002b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871'): ({'sde'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Removing single pathed devices sde {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898dfab-b602-42ed-9702-a5b23a265eec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f1b55d-2447-4452-80e3-6f6cd21f66d3]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flushing IO for device /dev/sde {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56fa772-a211-4740-8a40-3675f8de995a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba959e2-b5a9-4892-b9ca-1e8564d3a943]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a783564-d86a-48b0-b843-bcf6502ccf75]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c26f22-7509-44a7-a8c4-9ebe781eb12b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260]
Nov 15 01:32:55 user nova-compute[74880]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871, portal: 172.16.0.220,3260] successful.
Nov 15 01:32:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbab67f-baee-4604-bcc8-58bf906f9871 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[90421a13-91f1-436f-a0bd-c8e9c227c661]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== disconnect_volume: return (321ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:32:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG nova.objects.instance [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-6dd56cd3-52c0-4dc0-9421-63a75cda479f tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:32:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:32:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:33:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:33:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:33:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:33:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:13 user nova-compute[74880]: INFO nova.compute.manager [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Terminating instance
Nov 15 01:33:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-dff739db-5909-487a-83ae-9a9775142e6c req-844b36f9-a294-4892-b3df-66d58bc68144 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dff739db-5909-487a-83ae-9a9775142e6c req-844b36f9-a294-4892-b3df-66d58bc68144 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dff739db-5909-487a-83ae-9a9775142e6c req-844b36f9-a294-4892-b3df-66d58bc68144 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dff739db-5909-487a-83ae-9a9775142e6c req-844b36f9-a294-4892-b3df-66d58bc68144 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-dff739db-5909-487a-83ae-9a9775142e6c req-844b36f9-a294-4892-b3df-66d58bc68144 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-dff739db-5909-487a-83ae-9a9775142e6c req-844b36f9-a294-4892-b3df-66d58bc68144 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-unplugged-867c6194-568e-45ef-8222-558e115db573 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:33:14 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Instance destroyed successfully.
Nov 15 01:33:14 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'resources' on Instance uuid 395fbdae-60fb-4d53-a8b5-731eb60a1c18 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-944524409',display_name='tempest-AttachVolumeTestJSON-server-944524409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-944524409',id=27,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyfM/KUAQnBu7soNrU1vvPErb2zgXK0w8oVIj7gGyUyyO60/r1xvW08ttPGSDfwCVJ5833xUE+oAu1ac0oOmZRitEBprPDs0TtO8HJ3IjcR9ocso45Kx6ftvvZjUB0oIg==',key_name='tempest-keypair-1094025050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-xtd17065',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=395fbdae-60fb-4d53-a8b5-731eb60a1c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "867c6194-568e-45ef-8222-558e115db573", "address": "fa:16:3e:45:24:9c", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867c6194-56", "ovs_interfaceid": "867c6194-568e-45ef-8222-558e115db573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG os_vif [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867c6194-56, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0098f2f-c2d6-4595-a72d-da6a37b67b12) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:14 user nova-compute[74880]: INFO os_vif [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:24:9c,bridge_name='br-int',has_traffic_filtering=True,id=867c6194-568e-45ef-8222-558e115db573,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867c6194-56')
Nov 15 01:33:14 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Deleting instance files /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18_del
Nov 15 01:33:14 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Deletion of /opt/stack/data/nova/instances/395fbdae-60fb-4d53-a8b5-731eb60a1c18_del complete
Nov 15 01:33:14 user nova-compute[74880]: INFO nova.compute.manager [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 01:33:14 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:33:14 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:15 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Took 0.84 seconds to deallocate network for instance.
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:15 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Deleted allocations for instance 395fbdae-60fb-4d53-a8b5-731eb60a1c18
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e634c4f6-c36d-45c2-bc9b-bd6abbacb47c tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] Acquiring lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] Lock "395fbdae-60fb-4d53-a8b5-731eb60a1c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] No waiting events found dispatching network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:15 user nova-compute[74880]: WARNING nova.compute.manager [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received unexpected event network-vif-plugged-867c6194-568e-45ef-8222-558e115db573 for instance with vm_state deleted and task_state None.
Nov 15 01:33:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-95178d37-4c76-461d-97bf-26c343b94bc9 req-3cd98997-cd48-4237-b580-37f81cbfa288 service nova] [instance: 395fbdae-60fb-4d53-a8b5-731eb60a1c18] Received event network-vif-deleted-867c6194-568e-45ef-8222-558e115db573 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:16 user nova-compute[74880]: INFO nova.compute.manager [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Terminating instance
Nov 15 01:33:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Instance destroyed successfully.
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lazy-loading 'resources' on Instance uuid 11ebe5fe-f476-4a7b-ace2-b62e377c5b84 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1149569759',display_name='tempest-SnapshotDataIntegrityTests-server-1149569759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1149569759',id=33,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrYM0uqon58XfHuzF8o/XxPTEePC8hmDzp7VCzIfBvUI5lkHs+T3I1TReOFDA/oxxt33hKSd/gKcmDw28+smGCm77LgVsrdF3RvZV6PR+wshKcgnQi1Fs3JApjezuCY/Q==',key_name='tempest-keypair-1795074059',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='390def18dc1643a5ac9b7b8802f0d625',ramdisk_id='',reservation_id='r-jgt1339k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-581673142',owner_user_name='tempest-SnapshotDataIntegrityTests-581673142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:27:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e98c9ec2b54c2eba8c826f1d030a51',uuid=11ebe5fe-f476-4a7b-ace2-b62e377c5b84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Converting VIF {"id": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "address": "fa:16:3e:cf:05:d9", "network": {"id": "941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1795924829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "390def18dc1643a5ac9b7b8802f0d625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fb1c7f-7e", "ovs_interfaceid": "90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG os_vif [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90fb1c7f-7e, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0accd380-5ae0-4ef5-aa0d-9292562a7a65) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:17 user nova-compute[74880]: INFO os_vif [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:05:d9,bridge_name='br-int',has_traffic_filtering=True,id=90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b,network=Network(941fb3a7-f62f-44f4-a4c2-26a3ca6f0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fb1c7f-7e')
Nov 15 01:33:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Deleting instance files /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84_del
Nov 15 01:33:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Deletion of /opt/stack/data/nova/instances/11ebe5fe-f476-4a7b-ace2-b62e377c5b84_del complete
Nov 15 01:33:17 user nova-compute[74880]: INFO nova.compute.manager [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-vif-unplugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] No waiting events found dispatching network-vif-unplugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-vif-unplugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] Acquiring lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:17 user nova-compute[74880]: DEBUG nova.compute.manager [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] No waiting events found dispatching network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:17 user nova-compute[74880]: WARNING nova.compute.manager [req-e1562c90-1963-41ce-a3dd-f1d0af9dbac8 req-fa07feb3-52f8-40cf-9cfe-ed17c7cf7131 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received unexpected event network-vif-plugged-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b for instance with vm_state active and task_state deleting.
Nov 15 01:33:18 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:18 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Took 1.14 seconds to deallocate network for instance.
Nov 15 01:33:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:19 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:19 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:19 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Deleted allocations for instance 11ebe5fe-f476-4a7b-ace2-b62e377c5b84
Nov 15 01:33:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8af8eba5-a987-4341-a15c-66a13e34f930 tempest-SnapshotDataIntegrityTests-581673142 tempest-SnapshotDataIntegrityTests-581673142-project-member] Lock "11ebe5fe-f476-4a7b-ace2-b62e377c5b84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.445s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-73ab63ba-abc2-4358-8e5b-0c77dd9259e9 req-e366c278-f080-49c5-ae8e-90789f9f6611 service nova] [instance: 11ebe5fe-f476-4a7b-ace2-b62e377c5b84] Received event network-vif-deleted-90fb1c7f-7e95-4a5b-a7b9-e64d2ac8be9b {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:25 user nova-compute[74880]: INFO nova.compute.manager [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Terminating instance
Nov 15 01:33:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-84087d4c-1740-43d6-9b64-cae0e46e4009 req-502db67c-2a09-44ce-bcbf-abc28b4e52df service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-vif-unplugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-84087d4c-1740-43d6-9b64-cae0e46e4009 req-502db67c-2a09-44ce-bcbf-abc28b4e52df service nova] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-84087d4c-1740-43d6-9b64-cae0e46e4009 req-502db67c-2a09-44ce-bcbf-abc28b4e52df service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-84087d4c-1740-43d6-9b64-cae0e46e4009 req-502db67c-2a09-44ce-bcbf-abc28b4e52df service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-84087d4c-1740-43d6-9b64-cae0e46e4009 req-502db67c-2a09-44ce-bcbf-abc28b4e52df service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] No waiting events found dispatching network-vif-unplugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-84087d4c-1740-43d6-9b64-cae0e46e4009 req-502db67c-2a09-44ce-bcbf-abc28b4e52df service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-vif-unplugged-11498cda-9b15-4829-80a6-c12044df9a93 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:33:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Instance destroyed successfully.
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.objects.instance [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'resources' on Instance uuid f4c1939c-4166-41e1-a915-af269583b53a {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:27:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-20456554',display_name='tempest-AttachVolumeNegativeTest-server-20456554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-20456554',id=34,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1D1cU+GVZ2Ei3n7UeWMEsMmL50cSUMus5HtgwfiFExovs92xnRSIXzaciksHx3dxuYFdXlBNf5IUpoDKJVvgI9b/ty0RfvDDhTxOVH40wWdwgtIm2EPLcAWgX/O+fmNg==',key_name='tempest-keypair-1854920452',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:27:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-00uxcdf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=f4c1939c-4166-41e1-a915-af269583b53a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "11498cda-9b15-4829-80a6-c12044df9a93", "address": "fa:16:3e:86:a1:b9", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11498cda-9b", "ovs_interfaceid": "11498cda-9b15-4829-80a6-c12044df9a93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG os_vif [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11498cda-9b, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62141849-222a-4da7-a36a-08890a598efa) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:26 user nova-compute[74880]: INFO os_vif [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:a1:b9,bridge_name='br-int',has_traffic_filtering=True,id=11498cda-9b15-4829-80a6-c12044df9a93,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11498cda-9b')
Nov 15 01:33:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Deleting instance files /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a_del
Nov 15 01:33:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Deletion of /opt/stack/data/nova/instances/f4c1939c-4166-41e1-a915-af269583b53a_del complete
Nov 15 01:33:26 user nova-compute[74880]: INFO nova.compute.manager [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 01:33:26 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: f4c1939c-4166-41e1-a915-af269583b53a] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-changed-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Refreshing instance network info cache due to event network-changed-f87822e2-60ae-4497-b2cd-492efe32805a. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] Acquiring lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] Acquired lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:33:26 user nova-compute[74880]: DEBUG nova.network.neutron [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Refreshing network info cache for port f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updated VIF entry in instance network info cache for port f87822e2-60ae-4497-b2cd-492efe32805a. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.network.neutron [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updating instance_info_cache with network_info: [{"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-307450f8-2841-4922-a78c-3fa80b87ba67 req-0f1f78c0-750b-4231-b4a1-bcf0c75356fd service nova] Releasing lock "refresh_cache-207a3fcc-3571-44a6-ac2e-83beecf3f783" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:27 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Took 1.28 seconds to deallocate network for instance.
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-d71c80ee-d378-45ff-8ea5-5fb65fc0ac52 req-6c43a1ce-21fc-45be-9293-f39240caf580 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d71c80ee-d378-45ff-8ea5-5fb65fc0ac52 req-6c43a1ce-21fc-45be-9293-f39240caf580 service nova] Acquiring lock "f4c1939c-4166-41e1-a915-af269583b53a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d71c80ee-d378-45ff-8ea5-5fb65fc0ac52 req-6c43a1ce-21fc-45be-9293-f39240caf580 service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d71c80ee-d378-45ff-8ea5-5fb65fc0ac52 req-6c43a1ce-21fc-45be-9293-f39240caf580 service nova] Lock "f4c1939c-4166-41e1-a915-af269583b53a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.compute.manager [req-d71c80ee-d378-45ff-8ea5-5fb65fc0ac52 req-6c43a1ce-21fc-45be-9293-f39240caf580 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] No waiting events found dispatching network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:27 user nova-compute[74880]: WARNING nova.compute.manager [req-d71c80ee-d378-45ff-8ea5-5fb65fc0ac52 req-6c43a1ce-21fc-45be-9293-f39240caf580 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received unexpected event network-vif-plugged-11498cda-9b15-4829-80a6-c12044df9a93 for instance with vm_state deleted and task_state None.
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:27 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Deleted allocations for instance f4c1939c-4166-41e1-a915-af269583b53a
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-66183ab2-2844-48d9-b837-dad8bfb7873d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "f4c1939c-4166-41e1-a915-af269583b53a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.688s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:28 user nova-compute[74880]: INFO nova.compute.manager [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Terminating instance
Nov 15 01:33:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-2d1af3b5-36a4-4d7e-80c8-e57b2053216d req-8c12ac36-aca0-47fd-8743-f03fc4a0d259 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-vif-unplugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2d1af3b5-36a4-4d7e-80c8-e57b2053216d req-8c12ac36-aca0-47fd-8743-f03fc4a0d259 service nova] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2d1af3b5-36a4-4d7e-80c8-e57b2053216d req-8c12ac36-aca0-47fd-8743-f03fc4a0d259 service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2d1af3b5-36a4-4d7e-80c8-e57b2053216d req-8c12ac36-aca0-47fd-8743-f03fc4a0d259 service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-2d1af3b5-36a4-4d7e-80c8-e57b2053216d req-8c12ac36-aca0-47fd-8743-f03fc4a0d259 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] No waiting events found dispatching network-vif-unplugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-2d1af3b5-36a4-4d7e-80c8-e57b2053216d req-8c12ac36-aca0-47fd-8743-f03fc4a0d259 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-vif-unplugged-f87822e2-60ae-4497-b2cd-492efe32805a for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:33:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-9f8c8867-4399-4098-bd1f-90082758452c req-76abeca4-ada4-4f45-9d4e-3070125ab0a4 service nova] [instance: f4c1939c-4166-41e1-a915-af269583b53a] Received event network-vif-deleted-11498cda-9b15-4829-80a6-c12044df9a93 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Instance destroyed successfully.
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.objects.instance [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'resources' on Instance uuid 207a3fcc-3571-44a6-ac2e-83beecf3f783 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-748137313',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-748137313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-748137313',id=38,image_ref='c1a85bd5-f4fe-4d7b-bd1b-596ba7e63835',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlVZ99Ui3U5CbS60hun/5CzxWNyhFlbLrB5PFBgC6PCDkRJevFU3Nu61TTuV18TOoEi709DSUBbuv3V/HhRjGdW1kqLYV1eis+RzVhxxt9ZyVgFKCbDvkz5WNnJGA3dug==',key_name='tempest-keypair-1415310383',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:31:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-t77496lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1434286508',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=207a3fcc-3571-44a6-ac2e-83beecf3f783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "f87822e2-60ae-4497-b2cd-492efe32805a", "address": "fa:16:3e:58:25:6e", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf87822e2-60", "ovs_interfaceid": "f87822e2-60ae-4497-b2cd-492efe32805a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_vif [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf87822e2-60, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28ef33e4-08a1-4274-9c77-a57839270d9f) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:29 user nova-compute[74880]: INFO os_vif [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:25:6e,bridge_name='br-int',has_traffic_filtering=True,id=f87822e2-60ae-4497-b2cd-492efe32805a,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf87822e2-60')
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udJLBSIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:33:29 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[32480c38-72ee-43d5-81a2-0e1bb7f09948]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:33:29 user nova-compute[74880]: No targets found.
Nov 15 01:33:29 user nova-compute[74880]: iSNS:
Nov 15 01:33:29 user nova-compute[74880]: No targets found.
Nov 15 01:33:29 user nova-compute[74880]: STATIC:
Nov 15 01:33:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:33:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:33:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:33:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc
Nov 15 01:33:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:33:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:33:29 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:33:29 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:33:29 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:33:29 user nova-compute[74880]: FIRMWARE:
Nov 15 01:33:29 user nova-compute[74880]: No targets found.
Nov 15 01:33:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:33:29 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:33:29 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc762ede-08b9-4af1-b96a-7b5218ab6edf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d322fd69-5d0e-4af9-abbd-3be20e3df7da]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:33:29 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:33:29 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:33:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:33:29 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:33:29 user nova-compute[74880]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc (non-flash)
Nov 15 01:33:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01c05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d968a-f656-432a-a0ac-2e566c614595]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b586ac3-aa1c-4b5b-aad5-3c49357e380f]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a043c686-5b58-4a66-98f2-32ebd2610492]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1ae06-c492-47a8-ad42-687eb38cb51e]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23030663032333565', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_abf6ecda', '/dev/disk/by-id/scsi-1SCST_BIOabf6ecda-00f0235e0de1dfdf') {{(pid=85948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac28f9e-175c-4b1a-b9aa-05c6810cca06]: (4, None) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c688200c-92c2-4ab3-9496-5776e5d9599f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f9cb4d-452e-4b10-ae1b-1b17a1697682]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260]
Nov 15 01:33:29 user nova-compute[74880]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc, portal: 172.16.0.220,3260] successful.
Nov 15 01:33:29 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16676ea7-57f1-4a42-8ed5-327f0300bfdc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf88af4-af16-4ff2-b789-6861db67ae37]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== disconnect_volume: return (293ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:33:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Deleting instance files /opt/stack/data/nova/instances/207a3fcc-3571-44a6-ac2e-83beecf3f783_del
Nov 15 01:33:29 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Deletion of /opt/stack/data/nova/instances/207a3fcc-3571-44a6-ac2e-83beecf3f783_del complete
Nov 15 01:33:29 user nova-compute[74880]: INFO nova.compute.manager [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 01:33:29 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:33:29 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:33:30 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:30 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Took 0.74 seconds to deallocate network for instance.
Nov 15 01:33:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:33:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4da8484-30c2-432a-947c-fdd9daeef397 req-2251d582-79e4-4e29-814e-5aa32a5b9f7e service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4da8484-30c2-432a-947c-fdd9daeef397 req-2251d582-79e4-4e29-814e-5aa32a5b9f7e service nova] Acquiring lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4da8484-30c2-432a-947c-fdd9daeef397 req-2251d582-79e4-4e29-814e-5aa32a5b9f7e service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f4da8484-30c2-432a-947c-fdd9daeef397 req-2251d582-79e4-4e29-814e-5aa32a5b9f7e service nova] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-f4da8484-30c2-432a-947c-fdd9daeef397 req-2251d582-79e4-4e29-814e-5aa32a5b9f7e service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] No waiting events found dispatching network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:30 user nova-compute[74880]: WARNING nova.compute.manager [req-f4da8484-30c2-432a-947c-fdd9daeef397 req-2251d582-79e4-4e29-814e-5aa32a5b9f7e service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received unexpected event network-vif-plugged-f87822e2-60ae-4497-b2cd-492efe32805a for instance with vm_state active and task_state deleting.
Nov 15 01:33:30 user nova-compute[74880]: INFO nova.compute.manager [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] instance snapshotting
Nov 15 01:33:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-4b8dde46-9187-4b45-bd51-c3f7127bbe41 req-1de9842b-09dd-4983-88fd-670a7ccb35b8 service nova] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Received event network-vif-deleted-f87822e2-60ae-4497-b2cd-492efe32805a {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Beginning live snapshot process
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:31 user nova-compute[74880]: INFO nova.compute.manager [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Took 0.88 seconds to detach 1 volumes for instance.
Nov 15 01:33:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 207a3fcc-3571-44a6-ac2e-83beecf3f783] Deleting volume: 16676ea7-57f1-4a42-8ed5-327f0300bfdc {{(pid=74880) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json -f qcow2 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:31 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Deleted allocations for instance 207a3fcc-3571-44a6-ac2e-83beecf3f783
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp4b0f7sm/a82e580e61c6408582864fb04f586e8a.delta 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp4b0f7sm/a82e580e61c6408582864fb04f586e8a.delta 1073741824" returned: 0 in 0.055s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 01:33:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-551b5fe7-86a7-45eb-a2fa-d7a04e87ca7c tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "207a3fcc-3571-44a6-ac2e-83beecf3f783" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.409s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:33:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74880) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 01:33:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 01:33:33 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:33:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp4b0f7sm/a82e580e61c6408582864fb04f586e8a.delta /opt/stack/data/nova/instances/snapshots/tmpp4b0f7sm/a82e580e61c6408582864fb04f586e8a {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp4b0f7sm/a82e580e61c6408582864fb04f586e8a.delta /opt/stack/data/nova/instances/snapshots/tmpp4b0f7sm/a82e580e61c6408582864fb04f586e8a" returned: 0 in 0.690s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:33 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Snapshot extracted, beginning image upload
Nov 15 01:33:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Snapshot image upload complete
Nov 15 01:33:36 user nova-compute[74880]: INFO nova.compute.manager [None req-a8940bc3-289f-40d9-8a50-8f00867bd28f tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Took 5.77 seconds to snapshot the instance on the hypervisor.
Nov 15 01:33:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:33:45 user nova-compute[74880]: INFO nova.compute.claims [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Claim successful on node user
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:33:45 user nova-compute[74880]: DEBUG nova.network.neutron [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:33:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.policy [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e673708299e44c4dbe871e7fd1cf0dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889c4a61c654c9b90461d7c8f39473f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:33:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Creating image(s)
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk 1073741824" returned: 0 in 0.063s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.network.neutron [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Successfully created port: ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Cannot resize image /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Ensure instance console log exists: /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Successfully updated port: ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing instance network info cache due to event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance network_info: |[{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Start _get_guest_xml network_info=[{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:33:47 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:33:47 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2143680415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2143680415',id=41,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Oxku1pFVRbeFlj6kmyWm8J23XlwNWkQA8eH5GfqwsKxXuZNWjBdlWgybE0vSLMqLWdcNoXlI/jBenjueqJU5cZbz3f1+Lu0Ow5u7Ny3T1Ihy5gKjL08zp4rSenxESRg==',key_name='tempest-keypair-87033895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-brnwyvfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:33:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=8361002e-bba9-454c-addc-e740d02b6a4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.objects.instance [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'pci_devices' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:33:47 user nova-compute[74880]:   <uuid>8361002e-bba9-454c-addc-e740d02b6a4d</uuid>
Nov 15 01:33:47 user nova-compute[74880]:   <name>instance-00000029</name>
Nov 15 01:33:47 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:33:47 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:33:47 user nova-compute[74880]:   <metadata>
Nov 15 01:33:47 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:33:47 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:33:47 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2143680415</nova:name>
Nov 15 01:33:47 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:33:47</nova:creationTime>
Nov 15 01:33:47 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:33:47 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:33:47 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:33:47 user nova-compute[74880]:       <nova:owner>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:user uuid="e673708299e44c4dbe871e7fd1cf0dd4">tempest-AttachVolumeShelveTestJSON-1373123325-project-member</nova:user>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:project uuid="b889c4a61c654c9b90461d7c8f39473f">tempest-AttachVolumeShelveTestJSON-1373123325</nova:project>
Nov 15 01:33:47 user nova-compute[74880]:       </nova:owner>
Nov 15 01:33:47 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:33:47 user nova-compute[74880]:       <nova:ports>
Nov 15 01:33:47 user nova-compute[74880]:         <nova:port uuid="ccf3a5af-da88-48ce-afde-22d3c746c687">
Nov 15 01:33:47 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 01:33:47 user nova-compute[74880]:         </nova:port>
Nov 15 01:33:47 user nova-compute[74880]:       </nova:ports>
Nov 15 01:33:47 user nova-compute[74880]:     </nova:instance>
Nov 15 01:33:47 user nova-compute[74880]:   </metadata>
Nov 15 01:33:47 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:33:47 user nova-compute[74880]:     <system>
Nov 15 01:33:47 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:33:47 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:33:47 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:33:47 user nova-compute[74880]:       <entry name="serial">8361002e-bba9-454c-addc-e740d02b6a4d</entry>
Nov 15 01:33:47 user nova-compute[74880]:       <entry name="uuid">8361002e-bba9-454c-addc-e740d02b6a4d</entry>
Nov 15 01:33:47 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:33:47 user nova-compute[74880]:     </system>
Nov 15 01:33:47 user nova-compute[74880]:   </sysinfo>
Nov 15 01:33:47 user nova-compute[74880]:   <os>
Nov 15 01:33:47 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:33:47 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:33:47 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:33:47 user nova-compute[74880]:   </os>
Nov 15 01:33:47 user nova-compute[74880]:   <features>
Nov 15 01:33:47 user nova-compute[74880]:     <acpi/>
Nov 15 01:33:47 user nova-compute[74880]:     <apic/>
Nov 15 01:33:47 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:33:47 user nova-compute[74880]:   </features>
Nov 15 01:33:47 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:33:47 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:33:47 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:33:47 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:33:47 user nova-compute[74880]:   </clock>
Nov 15 01:33:47 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:33:47 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:33:47 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:33:47 user nova-compute[74880]:   </cpu>
Nov 15 01:33:47 user nova-compute[74880]:   <devices>
Nov 15 01:33:47 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:33:47 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:33:47 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk"/>
Nov 15 01:33:47 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:33:47 user nova-compute[74880]:     </disk>
Nov 15 01:33:47 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:33:47 user nova-compute[74880]:       <mac address="fa:16:3e:8f:de:ea"/>
Nov 15 01:33:47 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:33:47 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:33:47 user nova-compute[74880]:       <target dev="tapccf3a5af-da"/>
Nov 15 01:33:47 user nova-compute[74880]:     </interface>
Nov 15 01:33:47 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:33:47 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/console.log" append="off"/>
Nov 15 01:33:47 user nova-compute[74880]:     </serial>
Nov 15 01:33:47 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:33:47 user nova-compute[74880]:     <video>
Nov 15 01:33:47 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:33:47 user nova-compute[74880]:     </video>
Nov 15 01:33:47 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:33:47 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:33:47 user nova-compute[74880]:     </rng>
Nov 15 01:33:47 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:33:47 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:33:47 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:33:47 user nova-compute[74880]:     </memballoon>
Nov 15 01:33:47 user nova-compute[74880]:   </devices>
Nov 15 01:33:47 user nova-compute[74880]: </domain>
Nov 15 01:33:47 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2143680415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2143680415',id=41,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Oxku1pFVRbeFlj6kmyWm8J23XlwNWkQA8eH5GfqwsKxXuZNWjBdlWgybE0vSLMqLWdcNoXlI/jBenjueqJU5cZbz3f1+Lu0Ow5u7Ny3T1Ihy5gKjL08zp4rSenxESRg==',key_name='tempest-keypair-87033895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-brnwyvfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:33:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=8361002e-bba9-454c-addc-e740d02b6a4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG os_vif [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea0cff72-0102-5910-851a-63add59b1fc8', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf3a5af-da, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccf3a5af-da, col_values=(('qos', UUID('f9df9d95-4344-46cf-9bbd-219d0d3fa2a6')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccf3a5af-da, col_values=(('external_ids', {'iface-id': 'ccf3a5af-da88-48ce-afde-22d3c746c687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:de:ea', 'vm-uuid': '8361002e-bba9-454c-addc-e740d02b6a4d'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:47 user nova-compute[74880]: INFO os_vif [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da')
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No VIF found with MAC fa:16:3e:8f:de:ea, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updated VIF entry in instance network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:33:47 user nova-compute[74880]: DEBUG nova.network.neutron [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b7c685f6-55cb-49e8-a0a0-9b63f36d762f req-121d5b11-ad96-4904-9b58-054d383bf5b0 service nova] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-b6f68156-f4d8-40c5-94f7-a1727481b04f req-17a9bfd1-6534-466c-a177-77bf84a737e0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b6f68156-f4d8-40c5-94f7-a1727481b04f req-17a9bfd1-6534-466c-a177-77bf84a737e0 service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b6f68156-f4d8-40c5-94f7-a1727481b04f req-17a9bfd1-6534-466c-a177-77bf84a737e0 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b6f68156-f4d8-40c5-94f7-a1727481b04f req-17a9bfd1-6534-466c-a177-77bf84a737e0 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-b6f68156-f4d8-40c5-94f7-a1727481b04f req-17a9bfd1-6534-466c-a177-77bf84a737e0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:50 user nova-compute[74880]: WARNING nova.compute.manager [req-b6f68156-f4d8-40c5-94f7-a1727481b04f req-17a9bfd1-6534-466c-a177-77bf84a737e0 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state building and task_state spawning.
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:33:51 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance spawned successfully.
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:33:51 user nova-compute[74880]: INFO nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 15 01:33:51 user nova-compute[74880]: DEBUG nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:33:51 user nova-compute[74880]: INFO nova.compute.manager [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Took 5.97 seconds to build instance.
Nov 15 01:33:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-429b2956-0336-4f36-aa2e-88bb76368a5a tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.063s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-e00af474-9574-4f95-b30b-68859afddd67 req-fbc5a2ff-3ae8-4d2b-82cd-88382ae396c8 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e00af474-9574-4f95-b30b-68859afddd67 req-fbc5a2ff-3ae8-4d2b-82cd-88382ae396c8 service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e00af474-9574-4f95-b30b-68859afddd67 req-fbc5a2ff-3ae8-4d2b-82cd-88382ae396c8 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e00af474-9574-4f95-b30b-68859afddd67 req-fbc5a2ff-3ae8-4d2b-82cd-88382ae396c8 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-e00af474-9574-4f95-b30b-68859afddd67 req-fbc5a2ff-3ae8-4d2b-82cd-88382ae396c8 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:52 user nova-compute[74880]: WARNING nova.compute.manager [req-e00af474-9574-4f95-b30b-68859afddd67 req-fbc5a2ff-3ae8-4d2b-82cd-88382ae396c8 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state active and task_state None.
Nov 15 01:33:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "ca343268-f1e1-4474-95b1-338040b48523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:54 user nova-compute[74880]: INFO nova.compute.manager [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Terminating instance
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-dca13199-4ee4-44f0-b3bd-66d91ecd192b req-ff5df923-4e52-49d9-be8d-1588d0281882 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-unplugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dca13199-4ee4-44f0-b3bd-66d91ecd192b req-ff5df923-4e52-49d9-be8d-1588d0281882 service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dca13199-4ee4-44f0-b3bd-66d91ecd192b req-ff5df923-4e52-49d9-be8d-1588d0281882 service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dca13199-4ee4-44f0-b3bd-66d91ecd192b req-ff5df923-4e52-49d9-be8d-1588d0281882 service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-dca13199-4ee4-44f0-b3bd-66d91ecd192b req-ff5df923-4e52-49d9-be8d-1588d0281882 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-unplugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-dca13199-4ee4-44f0-b3bd-66d91ecd192b req-ff5df923-4e52-49d9-be8d-1588d0281882 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-unplugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ca343268-f1e1-4474-95b1-338040b48523] Instance destroyed successfully.
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.objects.instance [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lazy-loading 'resources' on Instance uuid ca343268-f1e1-4474-95b1-338040b48523 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772726477',display_name='tempest-VolumesActionsTest-instance-1772726477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772726477',id=40,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:32:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='646d3218ee4f4bf9809ae94da0dbd521',ramdisk_id='',reservation_id='r-j88doep9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-600661337',owner_user_name='tempest-VolumesActionsTest-600661337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:32:06Z,user_data=None,user_id='fac6c01f42dc4068bf96be9e8572628d',uuid=ca343268-f1e1-4474-95b1-338040b48523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Converting VIF {"id": "94870612-7775-49eb-9b23-08dac5f78301", "address": "fa:16:3e:20:6b:38", "network": {"id": "589a8ebe-6ee8-425a-af49-587a1d36ef15", "bridge": "br-int", "label": "tempest-VolumesActionsTest-414698954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "646d3218ee4f4bf9809ae94da0dbd521", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94870612-77", "ovs_interfaceid": "94870612-7775-49eb-9b23-08dac5f78301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG os_vif [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94870612-77, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83080b66-65b8-401d-b888-8e4c07cca214) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:33:54 user nova-compute[74880]: INFO os_vif [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:38,bridge_name='br-int',has_traffic_filtering=True,id=94870612-7775-49eb-9b23-08dac5f78301,network=Network(589a8ebe-6ee8-425a-af49-587a1d36ef15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94870612-77')
Nov 15 01:33:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Deleting instance files /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523_del
Nov 15 01:33:54 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Deletion of /opt/stack/data/nova/instances/ca343268-f1e1-4474-95b1-338040b48523_del complete
Nov 15 01:33:54 user nova-compute[74880]: INFO nova.compute.manager [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] [instance: ca343268-f1e1-4474-95b1-338040b48523] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: ca343268-f1e1-4474-95b1-338040b48523] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ca343268-f1e1-4474-95b1-338040b48523] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:33:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ca343268-f1e1-4474-95b1-338040b48523] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-d5a57d47-2558-4333-a26f-1543a28b20af req-482a780e-5630-4fe8-81bf-37a520599a15 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-deleted-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:55 user nova-compute[74880]: INFO nova.compute.manager [req-d5a57d47-2558-4333-a26f-1543a28b20af req-482a780e-5630-4fe8-81bf-37a520599a15 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Neutron deleted interface 94870612-7775-49eb-9b23-08dac5f78301; detaching it from the instance and deleting it from the info cache
Nov 15 01:33:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-d5a57d47-2558-4333-a26f-1543a28b20af req-482a780e-5630-4fe8-81bf-37a520599a15 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:55 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: ca343268-f1e1-4474-95b1-338040b48523] Took 0.58 seconds to deallocate network for instance.
Nov 15 01:33:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-d5a57d47-2558-4333-a26f-1543a28b20af req-482a780e-5630-4fe8-81bf-37a520599a15 service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Detach interface failed, port_id=94870612-7775-49eb-9b23-08dac5f78301, reason: Instance ca343268-f1e1-4474-95b1-338040b48523 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:55 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Deleted allocations for instance ca343268-f1e1-4474-95b1-338040b48523
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-56719671-d9de-420c-97a1-f950d809adf9 tempest-VolumesActionsTest-600661337 tempest-VolumesActionsTest-600661337-project-member] Lock "ca343268-f1e1-4474-95b1-338040b48523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Error from libvirt while getting description of instance-00000028: [Error Code 42] Domain not found: no domain with matching uuid 'ca343268-f1e1-4474-95b1-338040b48523' (instance-00000028): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ca343268-f1e1-4474-95b1-338040b48523' (instance-00000028)
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received unexpected event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with vm_state deleted and task_state None.
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received unexpected event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with vm_state deleted and task_state None.
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received unexpected event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with vm_state deleted and task_state None.
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Acquiring lock "ca343268-f1e1-4474-95b1-338040b48523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] Lock "ca343268-f1e1-4474-95b1-338040b48523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] No waiting events found dispatching network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.compute.manager [req-ac9f584a-25d7-44e2-9579-49e021f29d94 req-49c0b7df-bcfe-4a1e-b402-76bd7db1b5eb service nova] [instance: ca343268-f1e1-4474-95b1-338040b48523] Received unexpected event network-vif-plugged-94870612-7775-49eb-9b23-08dac5f78301 for instance with vm_state deleted and task_state None.
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:33:56 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8400MB free_disk=25.305431365966797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0f32696b-c386-48d2-aa46-9801f5356bfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8361002e-bba9-454c-addc-e740d02b6a4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:33:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:33:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:33:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:33:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:33:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:33:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:33:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:33:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:33:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:33:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:33:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:34:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:34:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:34:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:34:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:06 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:34:07 user nova-compute[74880]: INFO nova.compute.claims [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Claim successful on node user
Nov 15 01:34:07 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:34:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.policy [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66ea86fccfa749a6a52ac67af682af26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad971c8d358435095c37d13aac7a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:34:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Creating image(s)
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "/opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "/opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "/opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.168s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk 1073741824" returned: 0 in 0.054s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.187s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Cannot resize image /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Ensure instance console log exists: /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Successfully created port: 93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:34:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Successfully updated port: 93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquired lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-changed-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Refreshing instance network info cache due to event network-changed-93fa07e7-dd3e-4214-b4b9-7ffba072b645. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] Acquiring lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating instance_info_cache with network_info: [{"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Releasing lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Instance network_info: |[{"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] Acquired lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Refreshing network info cache for port 93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Start _get_guest_xml network_info=[{"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:34:10 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:34:10 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-541850427',display_name='tempest-AttachVolumeTestJSON-server-541850427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-541850427',id=42,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBWMksVRje4aC/pQXvXTSETMLEaJMq3AJioLh6D2vvsJFx17376JDOGRiNa4l1FyR/YlWh7FmB1uws9u/wxS7/xwQeJj42lMvQmspKTamPL74chIauBlJpcDAgK9l33OA==',key_name='tempest-keypair-323121258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-3r4fklub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=33737552-0ea5-47c5-9598-21ae37097a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'pci_devices' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:34:10 user nova-compute[74880]:   <uuid>33737552-0ea5-47c5-9598-21ae37097a20</uuid>
Nov 15 01:34:10 user nova-compute[74880]:   <name>instance-0000002a</name>
Nov 15 01:34:10 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:34:10 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:34:10 user nova-compute[74880]:   <metadata>
Nov 15 01:34:10 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:34:10 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:34:10 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeTestJSON-server-541850427</nova:name>
Nov 15 01:34:10 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:34:10</nova:creationTime>
Nov 15 01:34:10 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:34:10 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:34:10 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:34:10 user nova-compute[74880]:       <nova:owner>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:user uuid="66ea86fccfa749a6a52ac67af682af26">tempest-AttachVolumeTestJSON-1609488545-project-member</nova:user>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:project uuid="0ad971c8d358435095c37d13aac7a30c">tempest-AttachVolumeTestJSON-1609488545</nova:project>
Nov 15 01:34:10 user nova-compute[74880]:       </nova:owner>
Nov 15 01:34:10 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:34:10 user nova-compute[74880]:       <nova:ports>
Nov 15 01:34:10 user nova-compute[74880]:         <nova:port uuid="93fa07e7-dd3e-4214-b4b9-7ffba072b645">
Nov 15 01:34:10 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 01:34:10 user nova-compute[74880]:         </nova:port>
Nov 15 01:34:10 user nova-compute[74880]:       </nova:ports>
Nov 15 01:34:10 user nova-compute[74880]:     </nova:instance>
Nov 15 01:34:10 user nova-compute[74880]:   </metadata>
Nov 15 01:34:10 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:34:10 user nova-compute[74880]:     <system>
Nov 15 01:34:10 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:34:10 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:34:10 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:34:10 user nova-compute[74880]:       <entry name="serial">33737552-0ea5-47c5-9598-21ae37097a20</entry>
Nov 15 01:34:10 user nova-compute[74880]:       <entry name="uuid">33737552-0ea5-47c5-9598-21ae37097a20</entry>
Nov 15 01:34:10 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:34:10 user nova-compute[74880]:     </system>
Nov 15 01:34:10 user nova-compute[74880]:   </sysinfo>
Nov 15 01:34:10 user nova-compute[74880]:   <os>
Nov 15 01:34:10 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:34:10 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:34:10 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:34:10 user nova-compute[74880]:   </os>
Nov 15 01:34:10 user nova-compute[74880]:   <features>
Nov 15 01:34:10 user nova-compute[74880]:     <acpi/>
Nov 15 01:34:10 user nova-compute[74880]:     <apic/>
Nov 15 01:34:10 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:34:10 user nova-compute[74880]:   </features>
Nov 15 01:34:10 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:34:10 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:34:10 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:34:10 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:34:10 user nova-compute[74880]:   </clock>
Nov 15 01:34:10 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:34:10 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:34:10 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:34:10 user nova-compute[74880]:   </cpu>
Nov 15 01:34:10 user nova-compute[74880]:   <devices>
Nov 15 01:34:10 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:34:10 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:34:10 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk"/>
Nov 15 01:34:10 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:34:10 user nova-compute[74880]:     </disk>
Nov 15 01:34:10 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:34:10 user nova-compute[74880]:       <mac address="fa:16:3e:dd:96:9e"/>
Nov 15 01:34:10 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:34:10 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:34:10 user nova-compute[74880]:       <target dev="tap93fa07e7-dd"/>
Nov 15 01:34:10 user nova-compute[74880]:     </interface>
Nov 15 01:34:10 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:34:10 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/console.log" append="off"/>
Nov 15 01:34:10 user nova-compute[74880]:     </serial>
Nov 15 01:34:10 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:34:10 user nova-compute[74880]:     <video>
Nov 15 01:34:10 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:34:10 user nova-compute[74880]:     </video>
Nov 15 01:34:10 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:34:10 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:34:10 user nova-compute[74880]:     </rng>
Nov 15 01:34:10 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:34:10 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:34:10 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:34:10 user nova-compute[74880]:     </memballoon>
Nov 15 01:34:10 user nova-compute[74880]:   </devices>
Nov 15 01:34:10 user nova-compute[74880]: </domain>
Nov 15 01:34:10 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-541850427',display_name='tempest-AttachVolumeTestJSON-server-541850427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-541850427',id=42,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBWMksVRje4aC/pQXvXTSETMLEaJMq3AJioLh6D2vvsJFx17376JDOGRiNa4l1FyR/YlWh7FmB1uws9u/wxS7/xwQeJj42lMvQmspKTamPL74chIauBlJpcDAgK9l33OA==',key_name='tempest-keypair-323121258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-3r4fklub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=33737552-0ea5-47c5-9598-21ae37097a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG os_vif [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98403bde-f423-57c1-b899-c95ee1b5f2bc', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93fa07e7-dd, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93fa07e7-dd, col_values=(('qos', UUID('3e5d4a6b-b64c-459d-b544-a7215e9adc54')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93fa07e7-dd, col_values=(('external_ids', {'iface-id': '93fa07e7-dd3e-4214-b4b9-7ffba072b645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:96:9e', 'vm-uuid': '33737552-0ea5-47c5-9598-21ae37097a20'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:10 user nova-compute[74880]: INFO os_vif [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd')
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No VIF found with MAC fa:16:3e:dd:96:9e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updated VIF entry in instance network info cache for port 93fa07e7-dd3e-4214-b4b9-7ffba072b645. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating instance_info_cache with network_info: [{"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-746c93cb-e1d1-4023-8d68-ea61c76fb2f7 req-babd365b-9c5d-4745-a4f4-49bf0d260df1 service nova] Releasing lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-f03b4270-abf7-4e5a-b102-bf040500ce51 req-23b53319-0fc7-42cc-a08f-45607bb2ca62 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f03b4270-abf7-4e5a-b102-bf040500ce51 req-23b53319-0fc7-42cc-a08f-45607bb2ca62 service nova] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f03b4270-abf7-4e5a-b102-bf040500ce51 req-23b53319-0fc7-42cc-a08f-45607bb2ca62 service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f03b4270-abf7-4e5a-b102-bf040500ce51 req-23b53319-0fc7-42cc-a08f-45607bb2ca62 service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-f03b4270-abf7-4e5a-b102-bf040500ce51 req-23b53319-0fc7-42cc-a08f-45607bb2ca62 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] No waiting events found dispatching network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:12 user nova-compute[74880]: WARNING nova.compute.manager [req-f03b4270-abf7-4e5a-b102-bf040500ce51 req-23b53319-0fc7-42cc-a08f-45607bb2ca62 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received unexpected event network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 for instance with vm_state building and task_state spawning.
Nov 15 01:34:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:34:14 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Instance spawned successfully.
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-5a3c0c98-7db6-4ef8-9748-48852e0dc41c req-550f9611-85d7-4415-9160-894249471007 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5a3c0c98-7db6-4ef8-9748-48852e0dc41c req-550f9611-85d7-4415-9160-894249471007 service nova] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5a3c0c98-7db6-4ef8-9748-48852e0dc41c req-550f9611-85d7-4415-9160-894249471007 service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5a3c0c98-7db6-4ef8-9748-48852e0dc41c req-550f9611-85d7-4415-9160-894249471007 service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-5a3c0c98-7db6-4ef8-9748-48852e0dc41c req-550f9611-85d7-4415-9160-894249471007 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] No waiting events found dispatching network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:14 user nova-compute[74880]: WARNING nova.compute.manager [req-5a3c0c98-7db6-4ef8-9748-48852e0dc41c req-550f9611-85d7-4415-9160-894249471007 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received unexpected event network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 for instance with vm_state building and task_state spawning.
Nov 15 01:34:14 user nova-compute[74880]: INFO nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 15 01:34:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:34:14 user nova-compute[74880]: INFO nova.compute.manager [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Took 6.80 seconds to build instance.
Nov 15 01:34:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f92638f3-37f4-4ddf-a590-923e47aa4b23 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.892s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:34:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:18 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:34:18 user nova-compute[74880]: INFO nova.compute.claims [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Claim successful on node user
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.network.neutron [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:34:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.policy [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dd436c8ece5405789f44db4c8349c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9537a43f73f472c9d8c90ed75d72e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:34:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Creating image(s)
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "/opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.221s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:20 user nova-compute[74880]: INFO nova.compute.manager [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Terminating instance
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk 1073741824" returned: 0 in 0.058s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-09e967b8-536c-4b0a-8ee0-dc124fbd443a req-218bf7ab-2d16-49e5-bede-df98a71f747d service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-unplugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09e967b8-536c-4b0a-8ee0-dc124fbd443a req-218bf7ab-2d16-49e5-bede-df98a71f747d service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09e967b8-536c-4b0a-8ee0-dc124fbd443a req-218bf7ab-2d16-49e5-bede-df98a71f747d service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-09e967b8-536c-4b0a-8ee0-dc124fbd443a req-218bf7ab-2d16-49e5-bede-df98a71f747d service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-09e967b8-536c-4b0a-8ee0-dc124fbd443a req-218bf7ab-2d16-49e5-bede-df98a71f747d service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-unplugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-09e967b8-536c-4b0a-8ee0-dc124fbd443a req-218bf7ab-2d16-49e5-bede-df98a71f747d service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-unplugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Cannot resize image /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Ensure instance console log exists: /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Successfully created port: 81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:34:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Instance destroyed successfully.
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'resources' on Instance uuid 0f32696b-c386-48d2-aa46-9801f5356bfb {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-478274998',display_name='tempest-TestVolumeBootPattern-volume-backed-server-478274998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-478274998',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg0XQlhwQiDsN+v3wkFhYdzKxFu9LzQSZyRf4M4K1ZvD/FCqBy/0AdU4Hv9TPT09QrcAqASOrmUmqcOWa4l+5bbrmD25XcA6u6TlDnhayHZBQ30hex8EKvYifLVQnTsyw==',key_name='tempest-keypair-1714674865',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-z0z9ss2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=0f32696b-c386-48d2-aa46-9801f5356bfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "94995e36-96d0-4fe6-9b98-2394ecac9544", "address": "fa:16:3e:2b:a3:9d", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94995e36-96", "ovs_interfaceid": "94995e36-96d0-4fe6-9b98-2394ecac9544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_vif [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94995e36-96, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df45a42a-202d-431d-bcc5-070d83073d0d) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: INFO os_vif [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a3:9d,bridge_name='br-int',has_traffic_filtering=True,id=94995e36-96d0-4fe6-9b98-2394ecac9544,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94995e36-96')
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZOIfwAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:34:21 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9d6793-421e-4da5-9ead-231224830799]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:34:21 user nova-compute[74880]: No targets found.
Nov 15 01:34:21 user nova-compute[74880]: iSNS:
Nov 15 01:34:21 user nova-compute[74880]: No targets found.
Nov 15 01:34:21 user nova-compute[74880]: STATIC:
Nov 15 01:34:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:34:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:34:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:34:21 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9
Nov 15 01:34:21 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:34:21 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:34:21 user nova-compute[74880]: FIRMWARE:
Nov 15 01:34:21 user nova-compute[74880]: No targets found.
Nov 15 01:34:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:34:21 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:34:21 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d0c7b-401e-4960-9b0c-e2897232ed86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3d1318-f220-4b2b-b422-39eed25077bb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:34:21 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:34:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:34:21 user nova-compute[74880]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 (non-flash)
Nov 15 01:34:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f945e-59eb-466e-84fc-456286dea837]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.040s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22450a0-2ccf-46c9-ae24-609708c01945]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da145bd-4aa0-41bb-9091-e4194de21bb3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[46be0412-1dab-4cee-bbe4-c4b5cad180e8]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb51724cf-c6bd1397370d5b4a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b51724cf', '/dev/disk/by-id/scsi-26336626431333937') {{(pid=85948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b345d0-d41d-4ddc-b3fb-1d53db2f8e5f]: (4, None) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6801e6e4-c693-46a8-9195-771b77de3875]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c82de5-fd93-4d27-954f-8ce521398722]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260]
Nov 15 01:34:21 user nova-compute[74880]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9, portal: 172.16.0.220,3260] successful.
Nov 15 01:34:21 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612a3339-6310-4f9f-81ac-0f1a213000b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0a1323-dd75-4df7-96eb-3d11e765c618]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== disconnect_volume: return (364ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:34:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Deleting instance files /opt/stack/data/nova/instances/0f32696b-c386-48d2-aa46-9801f5356bfb_del
Nov 15 01:34:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Deletion of /opt/stack/data/nova/instances/0f32696b-c386-48d2-aa46-9801f5356bfb_del complete
Nov 15 01:34:21 user nova-compute[74880]: INFO nova.compute.manager [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Successfully updated port: 81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquired lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-changed-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Refreshing instance network info cache due to event network-changed-81c84dea-f798-4fff-9834-4ccb6539b398. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:34:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] Acquiring lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:22 user nova-compute[74880]: WARNING nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received unexpected event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with vm_state active and task_state deleting.
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:22 user nova-compute[74880]: WARNING nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received unexpected event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with vm_state active and task_state deleting.
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:22 user nova-compute[74880]: WARNING nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received unexpected event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with vm_state active and task_state deleting.
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-unplugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-unplugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-unplugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Acquiring lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] No waiting events found dispatching network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:22 user nova-compute[74880]: WARNING nova.compute.manager [req-11cafcac-b78e-4410-bfb5-0972681d10c6 req-a294a133-c874-4d91-a482-7844b19d9583 service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received unexpected event network-vif-plugged-94995e36-96d0-4fe6-9b98-2394ecac9544 for instance with vm_state active and task_state deleting.
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updating instance_info_cache with network_info: [{"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Releasing lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Instance network_info: |[{"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] Acquired lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Refreshing network info cache for port 81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Start _get_guest_xml network_info=[{"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:34:22 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:34:22 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-531757073',display_name='tempest-AttachVolumeNegativeTest-server-531757073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-531757073',id=43,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5T4F0o3BaOQsXRVIh161sl70TEs8u6ue/wevSEdndfAEJIEPjcX+hOsj34D2UZBSb3/S/2lvAat+7xsdGfK6cUnLKVMDPEo/Ek/GaBSUKdssDn7PtER12EbXZNzrGkEw==',key_name='tempest-keypair-924989542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-00xlct0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=035f18be-0875-4a41-b38e-3f27362b3b86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'pci_devices' on Instance uuid 035f18be-0875-4a41-b38e-3f27362b3b86 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:34:22 user nova-compute[74880]:   <uuid>035f18be-0875-4a41-b38e-3f27362b3b86</uuid>
Nov 15 01:34:22 user nova-compute[74880]:   <name>instance-0000002b</name>
Nov 15 01:34:22 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:34:22 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:34:22 user nova-compute[74880]:   <metadata>
Nov 15 01:34:22 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:34:22 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:34:22 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeNegativeTest-server-531757073</nova:name>
Nov 15 01:34:22 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:34:22</nova:creationTime>
Nov 15 01:34:22 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:34:22 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:34:22 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:34:22 user nova-compute[74880]:       <nova:owner>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:user uuid="1dd436c8ece5405789f44db4c8349c97">tempest-AttachVolumeNegativeTest-1148149593-project-member</nova:user>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:project uuid="c9537a43f73f472c9d8c90ed75d72e2d">tempest-AttachVolumeNegativeTest-1148149593</nova:project>
Nov 15 01:34:22 user nova-compute[74880]:       </nova:owner>
Nov 15 01:34:22 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:34:22 user nova-compute[74880]:       <nova:ports>
Nov 15 01:34:22 user nova-compute[74880]:         <nova:port uuid="81c84dea-f798-4fff-9834-4ccb6539b398">
Nov 15 01:34:22 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 01:34:22 user nova-compute[74880]:         </nova:port>
Nov 15 01:34:22 user nova-compute[74880]:       </nova:ports>
Nov 15 01:34:22 user nova-compute[74880]:     </nova:instance>
Nov 15 01:34:22 user nova-compute[74880]:   </metadata>
Nov 15 01:34:22 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:34:22 user nova-compute[74880]:     <system>
Nov 15 01:34:22 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:34:22 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:34:22 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:34:22 user nova-compute[74880]:       <entry name="serial">035f18be-0875-4a41-b38e-3f27362b3b86</entry>
Nov 15 01:34:22 user nova-compute[74880]:       <entry name="uuid">035f18be-0875-4a41-b38e-3f27362b3b86</entry>
Nov 15 01:34:22 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:34:22 user nova-compute[74880]:     </system>
Nov 15 01:34:22 user nova-compute[74880]:   </sysinfo>
Nov 15 01:34:22 user nova-compute[74880]:   <os>
Nov 15 01:34:22 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:34:22 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:34:22 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:34:22 user nova-compute[74880]:   </os>
Nov 15 01:34:22 user nova-compute[74880]:   <features>
Nov 15 01:34:22 user nova-compute[74880]:     <acpi/>
Nov 15 01:34:22 user nova-compute[74880]:     <apic/>
Nov 15 01:34:22 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:34:22 user nova-compute[74880]:   </features>
Nov 15 01:34:22 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:34:22 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:34:22 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:34:22 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:34:22 user nova-compute[74880]:   </clock>
Nov 15 01:34:22 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:34:22 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:34:22 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:34:22 user nova-compute[74880]:   </cpu>
Nov 15 01:34:22 user nova-compute[74880]:   <devices>
Nov 15 01:34:22 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:34:22 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:34:22 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk"/>
Nov 15 01:34:22 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:34:22 user nova-compute[74880]:     </disk>
Nov 15 01:34:22 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:34:22 user nova-compute[74880]:       <mac address="fa:16:3e:2b:9c:8c"/>
Nov 15 01:34:22 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:34:22 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:34:22 user nova-compute[74880]:       <target dev="tap81c84dea-f7"/>
Nov 15 01:34:22 user nova-compute[74880]:     </interface>
Nov 15 01:34:22 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:34:22 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/console.log" append="off"/>
Nov 15 01:34:22 user nova-compute[74880]:     </serial>
Nov 15 01:34:22 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:34:22 user nova-compute[74880]:     <video>
Nov 15 01:34:22 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:34:22 user nova-compute[74880]:     </video>
Nov 15 01:34:22 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:34:22 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:34:22 user nova-compute[74880]:     </rng>
Nov 15 01:34:22 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:34:22 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:34:22 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:34:22 user nova-compute[74880]:     </memballoon>
Nov 15 01:34:22 user nova-compute[74880]:   </devices>
Nov 15 01:34:22 user nova-compute[74880]: </domain>
Nov 15 01:34:22 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-531757073',display_name='tempest-AttachVolumeNegativeTest-server-531757073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-531757073',id=43,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5T4F0o3BaOQsXRVIh161sl70TEs8u6ue/wevSEdndfAEJIEPjcX+hOsj34D2UZBSb3/S/2lvAat+7xsdGfK6cUnLKVMDPEo/Ek/GaBSUKdssDn7PtER12EbXZNzrGkEw==',key_name='tempest-keypair-924989542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-00xlct0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=035f18be-0875-4a41-b38e-3f27362b3b86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG os_vif [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97fe6d02-2d22-5c52-8897-67182f56a37d', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81c84dea-f7, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81c84dea-f7, col_values=(('qos', UUID('52bbcfa1-64ef-4b61-a02a-f1a51503c323')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81c84dea-f7, col_values=(('external_ids', {'iface-id': '81c84dea-f798-4fff-9834-4ccb6539b398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:9c:8c', 'vm-uuid': '035f18be-0875-4a41-b38e-3f27362b3b86'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:22 user nova-compute[74880]: INFO os_vif [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7')
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:2b:9c:8c, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:34:22 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:22 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Took 1.35 seconds to deallocate network for instance.
Nov 15 01:34:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updated VIF entry in instance network info cache for port 81c84dea-f798-4fff-9834-4ccb6539b398. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:34:23 user nova-compute[74880]: DEBUG nova.network.neutron [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updating instance_info_cache with network_info: [{"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d1973ad0-0fb9-4065-a6af-3e350e100ff1 req-a1946d80-1592-4eee-9db3-de189ebd48d2 service nova] Releasing lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:23 user nova-compute[74880]: INFO nova.compute.manager [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Took 0.84 seconds to detach 1 volumes for instance.
Nov 15 01:34:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Deleting volume: 612a3339-6310-4f9f-81ac-0f1a213000b9 {{(pid=74880) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 01:34:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-56f67908-aa69-4f1b-b384-6df5588cc6a5 req-09aa72be-b529-485b-8036-1d32a1629acb service nova] [instance: 0f32696b-c386-48d2-aa46-9801f5356bfb] Received event network-vif-deleted-94995e36-96d0-4fe6-9b98-2394ecac9544 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:24 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Deleted allocations for instance 0f32696b-c386-48d2-aa46-9801f5356bfb
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c90f826-7804-45f8-ae62-64efd0484fe5 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "0f32696b-c386-48d2-aa46-9801f5356bfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.220s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] No waiting events found dispatching network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:24 user nova-compute[74880]: WARNING nova.compute.manager [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received unexpected event network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 for instance with vm_state building and task_state spawning.
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] No waiting events found dispatching network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:24 user nova-compute[74880]: WARNING nova.compute.manager [req-f686946f-8267-40cb-8208-3e090a63e6d6 req-2231435a-01f9-4550-b583-6efdb91d1c75 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received unexpected event network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 for instance with vm_state building and task_state spawning.
Nov 15 01:34:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:34:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Instance spawned successfully.
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:26 user nova-compute[74880]: INFO nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 15 01:34:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:34:26 user nova-compute[74880]: INFO nova.compute.manager [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Took 7.81 seconds to build instance.
Nov 15 01:34:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3e9e1bd6-6f73-4ff0-9093-82eaf9c1435b tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.902s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:34:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:38 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:34:38 user nova-compute[74880]: INFO nova.compute.claims [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Claim successful on node user
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:34:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.network.neutron [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:34:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.policy [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd34159a5cea6426f8e4303dbf20a99af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cac8f31694b1abcac7d3cfaac76ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:34:39 user nova-compute[74880]: INFO nova.virt.block_device [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Booting with volume-backed-image 9e9b279c-74a4-42a5-b459-aec607e3df19 at /dev/vda
Nov 15 01:34:39 user nova-compute[74880]: DEBUG nova.network.neutron [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Successfully created port: 4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Successfully updated port: 4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-changed-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Refreshing instance network info cache due to event network-changed-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] Acquiring lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance network_info: |[{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] Acquired lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Refreshing network info cache for port 4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:34:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updated VIF entry in instance network info cache for port 4eaf3540-8ef3-4f5d-af12-a9afb7b75b27. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:34:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cc627ec6-03de-4480-a65b-b17cb8381081 req-e9a04b5b-9597-49f5-ae47-43deb7b6e934 service nova] Releasing lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG os_brick.utils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e2a8d3-6708-4315-8558-5ec738de97ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[644bfcca-5f11-47e8-b8bf-995e436e394e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e2f967-8249-4cc5-b1f7-c329651acdfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ad074-bf2d-4a43-b171-e535d24bb2c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:34:45 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:34:45 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b58b3d-84eb-43ad-b9c0-e150c51e206a]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG os_brick.utils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:34:45 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating existing volume attachment record: 459cbd69-c321-4340-85d1-1bf9afbbd7fe {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:34:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:34:50 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Creating image(s)
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Ensure instance console log exists: /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Start _get_guest_xml network_info=[{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f126fb29-d56c-4f6b-9b79-a4944e5ce618', 'attached_at': '', 'detached_at': '', 'volume_id': '1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'serial': '1c8ec99f-862b-4b1d-b911-b82c051d0c23'}, 'mount_device': '/dev/vda', 'attachment_id': '459cbd69-c321-4340-85d1-1bf9afbbd7fe', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:34:50 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:34:50 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:34:50 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:34:50 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:34:50 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a67ac89-bd94-4df0-a6fc-196afbea62f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:34:50 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b32739-80b3-4061-8cc6-ff4bd50476f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23] added
Nov 15 01:34:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b316d12a-b041-47b4-8b08-86594bee777b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fbab3b-9e6e-4755-9bfe-fbf475e4c96b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEFwDQfR {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEFwDQfR" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceada413-20ae-46eb-a751-2f6c505e6461]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEFwDQfR'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bd3fa9-7f98-4f0d-96b0-1eba765baa58]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b979b-5833-40db-8d2d-15bd06daa13e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:34:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:34:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c3afd-d678-4c65-b788-caa0828dce50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260]
Nov 15 01:34:50 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260] successful.
Nov 15 01:34:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef242f4-334d-4175-9635-2f907c888668]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb2b193-e3f5-4bcc-b03f-5137fb9528ae]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:34:50 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:34:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:34:50 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:34:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff66896-023a-45a4-aefe-15d359485dc4]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:34:50 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26233366361623965', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233366361623965', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982436322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982436322',id=44,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-wkc5pu6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:39Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=f126fb29-d56c-4f6b-9b79-a4944e5ce618,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'pci_devices' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:34:51 user nova-compute[74880]:   <uuid>f126fb29-d56c-4f6b-9b79-a4944e5ce618</uuid>
Nov 15 01:34:51 user nova-compute[74880]:   <name>instance-0000002c</name>
Nov 15 01:34:51 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:34:51 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:34:51 user nova-compute[74880]:   <metadata>
Nov 15 01:34:51 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:34:51 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:34:51 user nova-compute[74880]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-982436322</nova:name>
Nov 15 01:34:51 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:34:50</nova:creationTime>
Nov 15 01:34:51 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:34:51 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:34:51 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:34:51 user nova-compute[74880]:       <nova:owner>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:user uuid="d34159a5cea6426f8e4303dbf20a99af">tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member</nova:user>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:project uuid="069cac8f31694b1abcac7d3cfaac76ed">tempest-ServerBootFromVolumeStableRescueTest-330586401</nova:project>
Nov 15 01:34:51 user nova-compute[74880]:       </nova:owner>
Nov 15 01:34:51 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:34:51 user nova-compute[74880]:       <nova:ports>
Nov 15 01:34:51 user nova-compute[74880]:         <nova:port uuid="4eaf3540-8ef3-4f5d-af12-a9afb7b75b27">
Nov 15 01:34:51 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:34:51 user nova-compute[74880]:         </nova:port>
Nov 15 01:34:51 user nova-compute[74880]:       </nova:ports>
Nov 15 01:34:51 user nova-compute[74880]:     </nova:instance>
Nov 15 01:34:51 user nova-compute[74880]:   </metadata>
Nov 15 01:34:51 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:34:51 user nova-compute[74880]:     <system>
Nov 15 01:34:51 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:34:51 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:34:51 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:34:51 user nova-compute[74880]:       <entry name="serial">f126fb29-d56c-4f6b-9b79-a4944e5ce618</entry>
Nov 15 01:34:51 user nova-compute[74880]:       <entry name="uuid">f126fb29-d56c-4f6b-9b79-a4944e5ce618</entry>
Nov 15 01:34:51 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:34:51 user nova-compute[74880]:     </system>
Nov 15 01:34:51 user nova-compute[74880]:   </sysinfo>
Nov 15 01:34:51 user nova-compute[74880]:   <os>
Nov 15 01:34:51 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:34:51 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:34:51 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:34:51 user nova-compute[74880]:   </os>
Nov 15 01:34:51 user nova-compute[74880]:   <features>
Nov 15 01:34:51 user nova-compute[74880]:     <acpi/>
Nov 15 01:34:51 user nova-compute[74880]:     <apic/>
Nov 15 01:34:51 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:34:51 user nova-compute[74880]:   </features>
Nov 15 01:34:51 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:34:51 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:34:51 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:34:51 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:34:51 user nova-compute[74880]:   </clock>
Nov 15 01:34:51 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:34:51 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:34:51 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:34:51 user nova-compute[74880]:   </cpu>
Nov 15 01:34:51 user nova-compute[74880]:   <devices>
Nov 15 01:34:51 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:34:51 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:34:51 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:34:51 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:34:51 user nova-compute[74880]:       <serial>1c8ec99f-862b-4b1d-b911-b82c051d0c23</serial>
Nov 15 01:34:51 user nova-compute[74880]:     </disk>
Nov 15 01:34:51 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:34:51 user nova-compute[74880]:       <mac address="fa:16:3e:59:f3:ef"/>
Nov 15 01:34:51 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:34:51 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:34:51 user nova-compute[74880]:       <target dev="tap4eaf3540-8e"/>
Nov 15 01:34:51 user nova-compute[74880]:     </interface>
Nov 15 01:34:51 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:34:51 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/console.log" append="off"/>
Nov 15 01:34:51 user nova-compute[74880]:     </serial>
Nov 15 01:34:51 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:34:51 user nova-compute[74880]:     <video>
Nov 15 01:34:51 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:34:51 user nova-compute[74880]:     </video>
Nov 15 01:34:51 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:34:51 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:34:51 user nova-compute[74880]:     </rng>
Nov 15 01:34:51 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:34:51 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:34:51 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:34:51 user nova-compute[74880]:     </memballoon>
Nov 15 01:34:51 user nova-compute[74880]:   </devices>
Nov 15 01:34:51 user nova-compute[74880]: </domain>
Nov 15 01:34:51 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982436322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982436322',id=44,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-wkc5pu6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:39Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=f126fb29-d56c-4f6b-9b79-a4944e5ce618,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG os_vif [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb271942-38a9-5f36-819b-20056faea2a0', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eaf3540-8e, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4eaf3540-8e, col_values=(('qos', UUID('e0db9478-c342-42a3-b139-aca6cb8b618d')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4eaf3540-8e, col_values=(('external_ids', {'iface-id': '4eaf3540-8ef3-4f5d-af12-a9afb7b75b27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:f3:ef', 'vm-uuid': 'f126fb29-d56c-4f6b-9b79-a4944e5ce618'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:51 user nova-compute[74880]: INFO os_vif [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e')
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:34:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No VIF found with MAC fa:16:3e:59:f3:ef, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:34:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c2f538d-5b79-4690-a68f-b2e201dc4146 req-b384813e-8e69-4b47-bfa8-8725adaa3958 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c2f538d-5b79-4690-a68f-b2e201dc4146 req-b384813e-8e69-4b47-bfa8-8725adaa3958 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c2f538d-5b79-4690-a68f-b2e201dc4146 req-b384813e-8e69-4b47-bfa8-8725adaa3958 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4c2f538d-5b79-4690-a68f-b2e201dc4146 req-b384813e-8e69-4b47-bfa8-8725adaa3958 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-4c2f538d-5b79-4690-a68f-b2e201dc4146 req-b384813e-8e69-4b47-bfa8-8725adaa3958 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:53 user nova-compute[74880]: WARNING nova.compute.manager [req-4c2f538d-5b79-4690-a68f-b2e201dc4146 req-b384813e-8e69-4b47-bfa8-8725adaa3958 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state building and task_state spawning.
Nov 15 01:34:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-d8076277-6d87-4d8f-8921-91ad30afa777 req-2794a0fb-e6ee-4105-8bf1-04a1bcc38b57 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d8076277-6d87-4d8f-8921-91ad30afa777 req-2794a0fb-e6ee-4105-8bf1-04a1bcc38b57 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d8076277-6d87-4d8f-8921-91ad30afa777 req-2794a0fb-e6ee-4105-8bf1-04a1bcc38b57 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d8076277-6d87-4d8f-8921-91ad30afa777 req-2794a0fb-e6ee-4105-8bf1-04a1bcc38b57 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-d8076277-6d87-4d8f-8921-91ad30afa777 req-2794a0fb-e6ee-4105-8bf1-04a1bcc38b57 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:34:55 user nova-compute[74880]: WARNING nova.compute.manager [req-d8076277-6d87-4d8f-8921-91ad30afa777 req-2794a0fb-e6ee-4105-8bf1-04a1bcc38b57 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state building and task_state spawning.
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:34:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance spawned successfully.
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:34:55 user nova-compute[74880]: INFO nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:34:55 user nova-compute[74880]: INFO nova.compute.manager [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Took 16.55 seconds to build instance.
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-83ec9032-8dc0-4606-b7eb-e1ebb1cb648c tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.641s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:34:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:56 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:34:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:34:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:34:56 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updating instance_info_cache with network_info: [{"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:57 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:34:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:35:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8102MB free_disk=25.235767364501953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8361002e-bba9-454c-addc-e740d02b6a4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 33737552-0ea5-47c5-9598-21ae37097a20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 035f18be-0875-4a41-b38e-3f27362b3b86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:35:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:35:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:35:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:35:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:35:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:35:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:35:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:35:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:35:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:19 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:35:19 user nova-compute[74880]: INFO nova.compute.claims [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Claim successful on node user
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:35:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.policy [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '484f6e472b2c4cb588dfab3cc9d3932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c2385409b4f5080bf3d81430ddbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:35:20 user nova-compute[74880]: INFO nova.virt.block_device [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Booting with volume 03779a9c-ae26-4476-9234-ec2884c41b93 at /dev/vda
Nov 15 01:35:20 user nova-compute[74880]: DEBUG os_brick.utils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df63465-f182-43ce-9728-bfb3be17dab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926e9af-eb25-47ad-abe9-97216afd6130]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4805a882-c4ad-446d-90a3-66a5c893c0cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8add2242-44e4-44d8-b519-3bcb16a34be2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:35:20 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:35:20 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66d0944-89f4-4b8a-9280-24ee0ad3c881]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG os_brick.utils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:35:20 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updating existing volume attachment record: 96134d59-87f9-4a00-9def-d2b3564602a0 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Successfully created port: db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Successfully updated port: db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquired lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-changed-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Refreshing instance network info cache due to event network-changed-db413f7d-e75f-4224-841f-45c471a54f6c. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] Acquiring lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:35:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updating instance_info_cache with network_info: [{"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Releasing lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Instance network_info: |[{"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] Acquired lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Refreshing network info cache for port db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updated VIF entry in instance network info cache for port db413f7d-e75f-4224-841f-45c471a54f6c. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updating instance_info_cache with network_info: [{"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0d1ffc50-a050-41b2-b583-62ca1f9bb43c req-699fbf50-45aa-49a8-b737-ccebdede5ca3 service nova] Releasing lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:35:25 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Creating image(s)
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Ensure instance console log exists: /opt/stack/data/nova/instances/cb603a34-9aac-486e-901f-3969bfb4e0c1/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Start _get_guest_xml network_info=[{"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb603a34-9aac-486e-901f-3969bfb4e0c1', 'attached_at': '', 'detached_at': '', 'volume_id': '03779a9c-ae26-4476-9234-ec2884c41b93', 'serial': '03779a9c-ae26-4476-9234-ec2884c41b93'}, 'mount_device': '/dev/vda', 'attachment_id': '96134d59-87f9-4a00-9def-d2b3564602a0', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:35:25 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:35:25 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:35:25 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:35:25 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:35:25 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5703b7-66bc-4772-809d-13d3e842bb5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:35:25 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[999bede5-96e4-4182-bcd4-6a3b5541feaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93] added
Nov 15 01:35:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[38077cd6-c7bc-42da-8e6f-82bdbf6a3000]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc4bc7-aec3-49a4-ab06-bbcb7a516cd5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WofTJepM {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WofTJepM" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4493ac18-76bd-4c0d-aa62-a3c96b3fe831]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WofTJepM'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[20566a52-2725-444a-a573-41bfbd2912e2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ce25d9-47b7-4884-8a7b-0dc9c223b42d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:35:25 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:35:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:35:25 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:35:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ec7627-9476-4fdd-b6a5-107499056575]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]
Nov 15 01:35:25 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.
Nov 15 01:35:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aca51b3-2091-4188-b9da-25242447311a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93269c4-a54e-41cb-8e58-a3818f0d2ddd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:35:25 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:35:25 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:35:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:35:25 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:35:25 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:35:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1126e3e1-45d8-442a-844a-efdf1bc7924b]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:35:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23635616262366237', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635616262366237', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-23955975',display_name='tempest-TestVolumeBootPattern-server-23955975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-23955975',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-i800xxs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:35:20Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=cb603a34-9aac-486e-901f-3969bfb4e0c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'pci_devices' on Instance uuid cb603a34-9aac-486e-901f-3969bfb4e0c1 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:35:26 user nova-compute[74880]:   <uuid>cb603a34-9aac-486e-901f-3969bfb4e0c1</uuid>
Nov 15 01:35:26 user nova-compute[74880]:   <name>instance-0000002d</name>
Nov 15 01:35:26 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:35:26 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:35:26 user nova-compute[74880]:   <metadata>
Nov 15 01:35:26 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:35:26 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:35:26 user nova-compute[74880]:       <nova:name>tempest-TestVolumeBootPattern-server-23955975</nova:name>
Nov 15 01:35:26 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:35:25</nova:creationTime>
Nov 15 01:35:26 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:35:26 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:35:26 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:35:26 user nova-compute[74880]:       <nova:owner>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:user uuid="484f6e472b2c4cb588dfab3cc9d3932a">tempest-TestVolumeBootPattern-1434286508-project-member</nova:user>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:project uuid="861c2385409b4f5080bf3d81430ddbf0">tempest-TestVolumeBootPattern-1434286508</nova:project>
Nov 15 01:35:26 user nova-compute[74880]:       </nova:owner>
Nov 15 01:35:26 user nova-compute[74880]:       <nova:ports>
Nov 15 01:35:26 user nova-compute[74880]:         <nova:port uuid="db413f7d-e75f-4224-841f-45c471a54f6c">
Nov 15 01:35:26 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 01:35:26 user nova-compute[74880]:         </nova:port>
Nov 15 01:35:26 user nova-compute[74880]:       </nova:ports>
Nov 15 01:35:26 user nova-compute[74880]:     </nova:instance>
Nov 15 01:35:26 user nova-compute[74880]:   </metadata>
Nov 15 01:35:26 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:35:26 user nova-compute[74880]:     <system>
Nov 15 01:35:26 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:35:26 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:35:26 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:35:26 user nova-compute[74880]:       <entry name="serial">cb603a34-9aac-486e-901f-3969bfb4e0c1</entry>
Nov 15 01:35:26 user nova-compute[74880]:       <entry name="uuid">cb603a34-9aac-486e-901f-3969bfb4e0c1</entry>
Nov 15 01:35:26 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:35:26 user nova-compute[74880]:     </system>
Nov 15 01:35:26 user nova-compute[74880]:   </sysinfo>
Nov 15 01:35:26 user nova-compute[74880]:   <os>
Nov 15 01:35:26 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:35:26 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:35:26 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:35:26 user nova-compute[74880]:   </os>
Nov 15 01:35:26 user nova-compute[74880]:   <features>
Nov 15 01:35:26 user nova-compute[74880]:     <acpi/>
Nov 15 01:35:26 user nova-compute[74880]:     <apic/>
Nov 15 01:35:26 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:35:26 user nova-compute[74880]:   </features>
Nov 15 01:35:26 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:35:26 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:35:26 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:35:26 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:35:26 user nova-compute[74880]:   </clock>
Nov 15 01:35:26 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:35:26 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:35:26 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:35:26 user nova-compute[74880]:   </cpu>
Nov 15 01:35:26 user nova-compute[74880]:   <devices>
Nov 15 01:35:26 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:35:26 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:35:26 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:35:26 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:35:26 user nova-compute[74880]:       <serial>03779a9c-ae26-4476-9234-ec2884c41b93</serial>
Nov 15 01:35:26 user nova-compute[74880]:     </disk>
Nov 15 01:35:26 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:35:26 user nova-compute[74880]:       <mac address="fa:16:3e:d6:7d:8f"/>
Nov 15 01:35:26 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:35:26 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:35:26 user nova-compute[74880]:       <target dev="tapdb413f7d-e7"/>
Nov 15 01:35:26 user nova-compute[74880]:     </interface>
Nov 15 01:35:26 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:35:26 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/cb603a34-9aac-486e-901f-3969bfb4e0c1/console.log" append="off"/>
Nov 15 01:35:26 user nova-compute[74880]:     </serial>
Nov 15 01:35:26 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:35:26 user nova-compute[74880]:     <video>
Nov 15 01:35:26 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:35:26 user nova-compute[74880]:     </video>
Nov 15 01:35:26 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:35:26 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:35:26 user nova-compute[74880]:     </rng>
Nov 15 01:35:26 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:35:26 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:35:26 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:35:26 user nova-compute[74880]:     </memballoon>
Nov 15 01:35:26 user nova-compute[74880]:   </devices>
Nov 15 01:35:26 user nova-compute[74880]: </domain>
Nov 15 01:35:26 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-23955975',display_name='tempest-TestVolumeBootPattern-server-23955975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-23955975',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-i800xxs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:35:20Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=cb603a34-9aac-486e-901f-3969bfb4e0c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG os_vif [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49b4200a-ab77-5bef-a7bf-21cb7c6b548e', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb413f7d-e7, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb413f7d-e7, col_values=(('qos', UUID('fb58a77c-85ee-4324-831b-9e44f79a6e7f')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb413f7d-e7, col_values=(('external_ids', {'iface-id': 'db413f7d-e75f-4224-841f-45c471a54f6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:7d:8f', 'vm-uuid': 'cb603a34-9aac-486e-901f-3969bfb4e0c1'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:26 user nova-compute[74880]: INFO os_vif [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7')
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:35:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No VIF found with MAC fa:16:3e:d6:7d:8f, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:35:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-c0dad343-95e3-4c65-956e-4c57891aa59e req-5a700aa4-05dd-4e21-b011-deba5dcdc3e3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c0dad343-95e3-4c65-956e-4c57891aa59e req-5a700aa4-05dd-4e21-b011-deba5dcdc3e3 service nova] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c0dad343-95e3-4c65-956e-4c57891aa59e req-5a700aa4-05dd-4e21-b011-deba5dcdc3e3 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c0dad343-95e3-4c65-956e-4c57891aa59e req-5a700aa4-05dd-4e21-b011-deba5dcdc3e3 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-c0dad343-95e3-4c65-956e-4c57891aa59e req-5a700aa4-05dd-4e21-b011-deba5dcdc3e3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] No waiting events found dispatching network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:35:28 user nova-compute[74880]: WARNING nova.compute.manager [req-c0dad343-95e3-4c65-956e-4c57891aa59e req-5a700aa4-05dd-4e21-b011-deba5dcdc3e3 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received unexpected event network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c for instance with vm_state building and task_state spawning.
Nov 15 01:35:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-16963971-5d79-416c-a067-aaad820b3b45 req-9fa2946f-bb91-405d-835e-0882ad14c408 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16963971-5d79-416c-a067-aaad820b3b45 req-9fa2946f-bb91-405d-835e-0882ad14c408 service nova] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16963971-5d79-416c-a067-aaad820b3b45 req-9fa2946f-bb91-405d-835e-0882ad14c408 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-16963971-5d79-416c-a067-aaad820b3b45 req-9fa2946f-bb91-405d-835e-0882ad14c408 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-16963971-5d79-416c-a067-aaad820b3b45 req-9fa2946f-bb91-405d-835e-0882ad14c408 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] No waiting events found dispatching network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:35:30 user nova-compute[74880]: WARNING nova.compute.manager [req-16963971-5d79-416c-a067-aaad820b3b45 req-9fa2946f-bb91-405d-835e-0882ad14c408 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received unexpected event network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c for instance with vm_state building and task_state spawning.
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:35:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Instance spawned successfully.
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:35:30 user nova-compute[74880]: INFO nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 15 01:35:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:35:30 user nova-compute[74880]: INFO nova.compute.manager [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Took 11.06 seconds to build instance.
Nov 15 01:35:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1d9bbed-e4fc-4d90-8e99-660ac16b9278 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.175s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing instance network info cache due to event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG nova.network.neutron [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG nova.network.neutron [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updated VIF entry in instance network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG nova.network.neutron [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-90f7d56d-cdd7-4558-860a-e8a537474a6c req-92a34eb2-f629-4a34-ab68-d7e95bbdd647 service nova] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:39 user nova-compute[74880]: INFO nova.compute.manager [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Shelving
Nov 15 01:35:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-8c2fd13f-7672-4ce4-95c9-815cdd4ccb54 req-af0586c5-4bcc-4525-9cce-8adcd4614671 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-unplugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8c2fd13f-7672-4ce4-95c9-815cdd4ccb54 req-af0586c5-4bcc-4525-9cce-8adcd4614671 service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8c2fd13f-7672-4ce4-95c9-815cdd4ccb54 req-af0586c5-4bcc-4525-9cce-8adcd4614671 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8c2fd13f-7672-4ce4-95c9-815cdd4ccb54 req-af0586c5-4bcc-4525-9cce-8adcd4614671 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-8c2fd13f-7672-4ce4-95c9-815cdd4ccb54 req-af0586c5-4bcc-4525-9cce-8adcd4614671 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-unplugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:35:39 user nova-compute[74880]: WARNING nova.compute.manager [req-8c2fd13f-7672-4ce4-95c9-815cdd4ccb54 req-af0586c5-4bcc-4525-9cce-8adcd4614671 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-unplugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state active and task_state shelving.
Nov 15 01:35:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance destroyed successfully.
Nov 15 01:35:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Beginning cold snapshot process
Nov 15 01:35:39 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:35:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk /opt/stack/data/nova/instances/snapshots/tmpv0mb_syg/17289ee5d26d476e8067f17fae693982 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk /opt/stack/data/nova/instances/snapshots/tmpv0mb_syg/17289ee5d26d476e8067f17fae693982" returned: 0 in 1.239s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Snapshot extracted, beginning image upload
Nov 15 01:35:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-b8b0bdc9-a60e-451c-b097-cb6d66400bc4 req-94806739-f197-45a5-a766-907526e9eed7 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b8b0bdc9-a60e-451c-b097-cb6d66400bc4 req-94806739-f197-45a5-a766-907526e9eed7 service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b8b0bdc9-a60e-451c-b097-cb6d66400bc4 req-94806739-f197-45a5-a766-907526e9eed7 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b8b0bdc9-a60e-451c-b097-cb6d66400bc4 req-94806739-f197-45a5-a766-907526e9eed7 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-b8b0bdc9-a60e-451c-b097-cb6d66400bc4 req-94806739-f197-45a5-a766-907526e9eed7 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:35:41 user nova-compute[74880]: WARNING nova.compute.manager [req-b8b0bdc9-a60e-451c-b097-cb6d66400bc4 req-94806739-f197-45a5-a766-907526e9eed7 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 01:35:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Snapshot image upload complete
Nov 15 01:35:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:35:43 user nova-compute[74880]: INFO nova.compute.manager [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Shelve offloading
Nov 15 01:35:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance destroyed successfully.
Nov 15 01:35:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:35:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:43 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.network.neutron [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance destroyed successfully.
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'resources' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2143680415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2143680415',id=41,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Oxku1pFVRbeFlj6kmyWm8J23XlwNWkQA8eH5GfqwsKxXuZNWjBdlWgybE0vSLMqLWdcNoXlI/jBenjueqJU5cZbz3f1+Lu0Ow5u7Ny3T1Ihy5gKjL08zp4rSenxESRg==',key_name='tempest-keypair-87033895',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:33:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-brnwyvfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member',shelved_at='2023-11-15T01:35:43.593351',shelved_host='user',shelved_image_id='7dfbff4b-f98e-4834-b3fa-7851b0a93926'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:35:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=8361002e-bba9-454c-addc-e740d02b6a4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG os_vif [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf3a5af-da, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing instance network info cache due to event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.network.neutron [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9df9d95-4344-46cf-9bbd-219d0d3fa2a6) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:44 user nova-compute[74880]: INFO os_vif [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da')
Nov 15 01:35:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Deleting instance files /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d_del
Nov 15 01:35:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Deletion of /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d_del complete
Nov 15 01:35:44 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Deleted allocations for instance 8361002e-bba9-454c-addc-e740d02b6a4d
Nov 15 01:35:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'numa_topology' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:35:44 user nova-compute[74880]: DEBUG nova.objects.base [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<8361002e-bba9-454c-addc-e740d02b6a4d> lazy-loaded attributes: resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updated VIF entry in instance network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapccf3a5af-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-493093ec-9e8a-425e-b401-d465f4830a55 req-86056a1a-f8a6-4a1f-8f44-fc33c5fcc0df service nova] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c1a8bd86-d1dd-4b34-9b90-bfa016d57a26 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.223s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:54 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:35:57 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-changed-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.compute.manager [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Refreshing instance network info cache due to event network-changed-93fa07e7-dd3e-4214-b4b9-7ffba072b645. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] Acquiring lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] Acquired lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.network.neutron [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Refreshing network info cache for port 93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updated VIF entry in instance network info cache for port 93fa07e7-dd3e-4214-b4b9-7ffba072b645. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG nova.network.neutron [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating instance_info_cache with network_info: [{"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6deab69f-b3f7-4b06-aa3e-1697f4320232 req-9b9fb639-9c6c-4598-ad40-4877c31527a6 service nova] Releasing lock "refresh_cache-33737552-0ea5-47c5-9598-21ae37097a20" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:35:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:36:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:36:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8136MB free_disk=25.210716247558594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 33737552-0ea5-47c5-9598-21ae37097a20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 035f18be-0875-4a41-b38e-3f27362b3b86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance cb603a34-9aac-486e-901f-3969bfb4e0c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:36:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG nova.objects.instance [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:01 user nova-compute[74880]: INFO nova.compute.manager [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attaching volume 758d2560-0210-441a-abc7-fcda887957b2 to /dev/vdb
Nov 15 01:36:01 user nova-compute[74880]: DEBUG os_brick.utils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d863643b-6b1d-4f3b-b5b4-e077cfa24e0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a15dfb-ec5b-4a5c-9b95-3507d738887b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d2d165-f3d9-45e5-b40c-f867516429da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bfaaf4-8fd0-48dd-9b90-9b5df55ad177]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:36:01 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:36:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c49cd-1efe-421a-8976-45294e2f94d3]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG os_brick.utils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:01 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating existing volume attachment record: 1ed5ece4-5b9c-41f2-9604-485eaf87db86 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:36:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:36:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrvBUVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:06 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:06 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac1215e-df2e-4639-9d1c-5db5ce2a039d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:36:06 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54bbc91-db2c-4a08-b393-58a04f9ca581]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2] added
Nov 15 01:36:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[463dd1b0-bab3-4e11-9cc2-75efdb8458b4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1529b211-cefe-4882-9d0a-9c856a39f320]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrvBUVHA {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrvBUVHA" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40027556-c216-4685-895a-817a09a230c9]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrvBUVHA'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146175f-28cd-49fb-991a-2086135719ef]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9c758-b84d-4853-aa5d-94325ae9726c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[834af59a-6fd6-44f5-a122-44e73c04d209]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260]
Nov 15 01:36:06 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260] successful.
Nov 15 01:36:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86a6c1f-90d4-4863-a43a-f306a462639d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[90665d04-2202-4114-9d8c-6cf160a4bb09]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:06 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4fd17f-63ad-4966-96b8-b5bd30239adc]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:36:06 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrvBUVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23538363662303763', 'path': '/dev/sde'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538363662303763', 'path': '/dev/sde'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG nova.objects.instance [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:36:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:07 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:36:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:36:07 user nova-compute[74880]:   <serial>758d2560-0210-441a-abc7-fcda887957b2</serial>
Nov 15 01:36:07 user nova-compute[74880]: </disk>
Nov 15 01:36:07 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:36:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No VIF found with MAC fa:16:3e:dd:96:9e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:36:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-cd71168a-cc74-4603-a339-835a59e4f785 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.653s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:09 user nova-compute[74880]: DEBUG nova.compute.manager [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-changed-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:36:09 user nova-compute[74880]: DEBUG nova.compute.manager [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Refreshing instance network info cache due to event network-changed-81c84dea-f798-4fff-9834-4ccb6539b398. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:36:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] Acquiring lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:36:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] Acquired lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:36:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Refreshing network info cache for port 81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updated VIF entry in instance network info cache for port 81c84dea-f798-4fff-9834-4ccb6539b398. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG nova.network.neutron [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updating instance_info_cache with network_info: [{"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c06b212b-8a07-43cb-abab-9d21a0717d2b req-1a1b102f-062c-419e-96bf-f803438c2d70 service nova] Releasing lock "refresh_cache-035f18be-0875-4a41-b38e-3f27362b3b86" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG nova.objects.instance [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:11 user nova-compute[74880]: INFO nova.compute.manager [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attaching volume a1c7aecf-d690-4d4f-b873-75324302d75b to /dev/vdc
Nov 15 01:36:11 user nova-compute[74880]: DEBUG os_brick.utils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2c8bd7-0b78-4484-8291-8211a432a85f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77a6291-188d-46db-acfe-30510f04230b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69079287-66ef-4411-ae30-805872c42e0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a792930-863a-4a84-a92c-2bdeeabdd4da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:36:11 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:36:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3c97a-a365-4d6b-88df-6cd941d9012c]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG os_brick.utils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:11 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating existing volume attachment record: 7ddbd7f7-6a9f-445a-85ff-75d645a0c0c6 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG nova.objects.instance [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid 035f18be-0875-4a41-b38e-3f27362b3b86 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:12 user nova-compute[74880]: INFO nova.compute.manager [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Attaching volume 4fdfa43a-d8e0-4897-9088-affc9172359d to /dev/vdb
Nov 15 01:36:12 user nova-compute[74880]: DEBUG os_brick.utils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[36914457-1b04-4526-b74d-2b1a56d19721]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1794cd12-63cd-4f3b-a022-1393757c88da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafd9b45-dc5b-468f-a6c7-0b779b1e56d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aade8e-ed76-4aab-88fa-75e881ef1c22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:36:12 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:36:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c167f-d26b-4741-8c3b-3ae7fbdffba3]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG os_brick.utils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:12 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updating existing volume attachment record: 4e05d0bc-83ec-427d-9e14-ad71d0aae949 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:36:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLqbIPnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:15 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:15 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:15 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[404b0faf-258c-471c-95bb-9881b523fab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:36:15 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa89b999-4d37-448f-9a8d-1684ab771b7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b] added
Nov 15 01:36:15 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb31044-c305-4302-8e4b-387840cebae0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e3a1a5-c144-4f9b-aa9f-d2ecfcd7104c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLqbIPnT {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLqbIPnT" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f128f1-ace6-4a98-bb55-315c4a62db4b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLqbIPnT'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27fb42-481f-4415-8daa-714da5ca236f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7b5f82-1829-4a03-8803-201462f58f51]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[96acf84a-962e-4628-b13c-284460835275]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260]
Nov 15 01:36:16 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260] successful.
Nov 15 01:36:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c40c3-1732-4dae-b193-cc646aa06462]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e392a28d-ff8c-4864-8c34-bd5e05d6683f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:16 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:16 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] HCTL ('37', '-', '-', 0) found on session 54 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9415713-1b72-4470-b7c9-6eb781569f3e]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:36:16 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLqbIPnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23139376131663830', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139376131663830', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.objects.instance [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:36:17 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:17 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:36:17 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:36:17 user nova-compute[74880]:   <serial>a1c7aecf-d690-4d4f-b873-75324302d75b</serial>
Nov 15 01:36:17 user nova-compute[74880]: </disk>
Nov 15 01:36:17 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEIHRChp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:17 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:17 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:17 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9577ab1-8a6e-4315-b6bb-c7acad92f3b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:36:17 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] No VIF found with MAC fa:16:3e:dd:96:9e, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f521460-c095-4e62-be12-20f8ac4291cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d] added
Nov 15 01:36:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4597c-095e-4036-b714-0bc9dd3886bb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a34de4a-c219-4e4b-95e6-cff85234f46e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEIHRChp {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEIHRChp" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc53ae-c20b-4332-92f8-5de66c2c336f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEIHRChp'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0bb1a-9b74-4d77-89f3-4d46b9e912a5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-709d88b4-bce7-41e6-bfa5-90b686b1ee80 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.739s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d5d28-a45a-4718-8ccb-a64a187ee515]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc86887-a79d-4b2d-8b26-fa11e65080c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260]
Nov 15 01:36:17 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260] successful.
Nov 15 01:36:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc1242-eb4d-44b6-8a84-c5f566537de0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bce207-d8a4-434f-87e1-e21a5959af37]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:17 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:17 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] HCTL ('38', '-', '-', 0) found on session 55 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee727c-fb7a-492d-b26a-8eba9cca8006]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching for a device in session 55 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:36:17 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEIHRChp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:36:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:18 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23837626137316331', 'path': '/dev/sdg'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837626137316331', 'path': '/dev/sdg'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:36:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid 035f18be-0875-4a41-b38e-3f27362b3b86 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:36:19 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:19 user nova-compute[74880]:   <source dev="/dev/sdg"/>
Nov 15 01:36:19 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:36:19 user nova-compute[74880]:   <serial>4fdfa43a-d8e0-4897-9088-affc9172359d</serial>
Nov 15 01:36:19 user nova-compute[74880]: </disk>
Nov 15 01:36:19 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:19 user nova-compute[74880]: INFO nova.compute.manager [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Detaching volume 758d2560-0210-441a-abc7-fcda887957b2
Nov 15 01:36:19 user nova-compute[74880]: INFO nova.virt.block_device [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attempting to driver detach volume 758d2560-0210-441a-abc7-fcda887957b2 from mountpoint /dev/vdb
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Attempting to detach device vdb from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:36:19 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:19 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:36:19 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:36:19 user nova-compute[74880]:   <serial>758d2560-0210-441a-abc7-fcda887957b2</serial>
Nov 15 01:36:19 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:36:19 user nova-compute[74880]: </disk>
Nov 15 01:36:19 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:36:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully detached device vdb from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the persistent domain config.
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:36:19 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:19 user nova-compute[74880]:   <source dev="/dev/sde"/>
Nov 15 01:36:19 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:36:19 user nova-compute[74880]:   <serial>758d2560-0210-441a-abc7-fcda887957b2</serial>
Nov 15 01:36:19 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:36:19 user nova-compute[74880]: </disk>
Nov 15 01:36:19 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:2b:9c:8c, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-27d6020e-c129-4268-9841-7c6f30c8483a tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.830s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:36:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:20 user nova-compute[74880]: INFO nova.compute.manager [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Detaching volume 4fdfa43a-d8e0-4897-9088-affc9172359d
Nov 15 01:36:20 user nova-compute[74880]: INFO nova.virt.block_device [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Attempting to driver detach volume 4fdfa43a-d8e0-4897-9088-affc9172359d from mountpoint /dev/vdb
Nov 15 01:36:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Attempting to detach device vdb from instance 035f18be-0875-4a41-b38e-3f27362b3b86 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:36:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:36:20 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:20 user nova-compute[74880]:   <source dev="/dev/sdg"/>
Nov 15 01:36:20 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:36:20 user nova-compute[74880]:   <serial>4fdfa43a-d8e0-4897-9088-affc9172359d</serial>
Nov 15 01:36:20 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:36:20 user nova-compute[74880]: </disk>
Nov 15 01:36:20 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:36:20 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully detached device vdb from instance 035f18be-0875-4a41-b38e-3f27362b3b86 from the persistent domain config.
Nov 15 01:36:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 035f18be-0875-4a41-b38e-3f27362b3b86 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:36:20 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:36:20 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:20 user nova-compute[74880]:   <source dev="/dev/sdg"/>
Nov 15 01:36:20 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:36:20 user nova-compute[74880]:   <serial>4fdfa43a-d8e0-4897-9088-affc9172359d</serial>
Nov 15 01:36:20 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:36:20 user nova-compute[74880]: </disk>
Nov 15 01:36:20 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:36:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 035f18be-0875-4a41-b38e-3f27362b3b86 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:36:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:29 user nova-compute[74880]: INFO nova.compute.manager [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Rescuing
Nov 15 01:36:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:36:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:36:29 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:36:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:29 user nova-compute[74880]: DEBUG nova.network.neutron [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:36:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-e3d0c240-063c-4f3d-802d-1a35cd1ac33f req-78ca6c9b-4a19-4b4a-a1b1-d5aa26c3b3e3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e3d0c240-063c-4f3d-802d-1a35cd1ac33f req-78ca6c9b-4a19-4b4a-a1b1-d5aa26c3b3e3 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e3d0c240-063c-4f3d-802d-1a35cd1ac33f req-78ca6c9b-4a19-4b4a-a1b1-d5aa26c3b3e3 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e3d0c240-063c-4f3d-802d-1a35cd1ac33f req-78ca6c9b-4a19-4b4a-a1b1-d5aa26c3b3e3 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-e3d0c240-063c-4f3d-802d-1a35cd1ac33f req-78ca6c9b-4a19-4b4a-a1b1-d5aa26c3b3e3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:36:30 user nova-compute[74880]: WARNING nova.compute.manager [req-e3d0c240-063c-4f3d-802d-1a35cd1ac33f req-78ca6c9b-4a19-4b4a-a1b1-d5aa26c3b3e3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state active and task_state rescuing.
Nov 15 01:36:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance destroyed successfully.
Nov 15 01:36:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Attempting a stable device rescue
Nov 15 01:36:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74880) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance directory exists: not creating {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 01:36:30 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Creating image(s)
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "/opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "/opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'trusted_certs' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "27afb3fffe8aa274cb87e32153030da69370829e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "27afb3fffe8aa274cb87e32153030da69370829e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:31 user nova-compute[74880]: DEBUG nova.virt.images [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] dd657349-dd67-419e-997e-16f6e7129f90 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:36:31 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:36:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.part /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-77aa6f73-4ef3-42f3-b800-5d2d16235d87 req-ab49d55d-4892-40f8-936f-385ec360a659 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77aa6f73-4ef3-42f3-b800-5d2d16235d87 req-ab49d55d-4892-40f8-936f-385ec360a659 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77aa6f73-4ef3-42f3-b800-5d2d16235d87 req-ab49d55d-4892-40f8-936f-385ec360a659 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77aa6f73-4ef3-42f3-b800-5d2d16235d87 req-ab49d55d-4892-40f8-936f-385ec360a659 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-77aa6f73-4ef3-42f3-b800-5d2d16235d87 req-ab49d55d-4892-40f8-936f-385ec360a659 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:36:32 user nova-compute[74880]: WARNING nova.compute.manager [req-77aa6f73-4ef3-42f3-b800-5d2d16235d87 req-ab49d55d-4892-40f8-936f-385ec360a659 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state active and task_state rescuing.
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.part /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.converted" returned: 0 in 0.387s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "27afb3fffe8aa274cb87e32153030da69370829e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.874s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "27afb3fffe8aa274cb87e32153030da69370829e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "27afb3fffe8aa274cb87e32153030da69370829e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e,backing_fmt=raw /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e,backing_fmt=raw /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue" returned: 0 in 0.049s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "27afb3fffe8aa274cb87e32153030da69370829e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'migration_context' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<f126fb29-d56c-4f6b-9b79-a4944e5ce618> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Start _get_guest_xml network_info=[{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "vif_mac": "fa:16:3e:59:f3:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd657349-dd67-419e-997e-16f6e7129f90', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f126fb29-d56c-4f6b-9b79-a4944e5ce618', 'attached_at': '', 'detached_at': '', 'volume_id': '1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'serial': '1c8ec99f-862b-4b1d-b911-b82c051d0c23'}, 'mount_device': '/dev/vda', 'attachment_id': '459cbd69-c321-4340-85d1-1bf9afbbd7fe', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'resources' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<f126fb29-d56c-4f6b-9b79-a4944e5ce618> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'numa_topology' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<f126fb29-d56c-4f6b-9b79-a4944e5ce618> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:36:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:36:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'vcpu_model' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.objects.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<f126fb29-d56c-4f6b-9b79-a4944e5ce618> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:32 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:32 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:32 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:33 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e90c07-4f23-4b65-8c25-14882c99603b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UEFwDQfR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 01:36:33 user nova-compute[74880]: node.name = iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:36:33 user nova-compute[74880]: node.tpgt = -1
Nov 15 01:36:33 user nova-compute[74880]: node.startup = automatic
Nov 15 01:36:33 user nova-compute[74880]: node.leading_login = No
Nov 15 01:36:33 user nova-compute[74880]: iface.iscsi_ifacename = default
Nov 15 01:36:33 user nova-compute[74880]: iface.net_ifacename = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.ipaddress = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.prefix_len = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.hwaddress = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.transport_name = tcp
Nov 15 01:36:33 user nova-compute[74880]: iface.initiatorname = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.vlan_id = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.vlan_priority = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.vlan_state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.iface_num = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.mtu = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.port = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.bootproto = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.subnet_mask = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.gateway = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_alt_client_id = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_dns = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_learn_iqn = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_vendor_id_state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_vendor_id = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.dhcp_slp_da = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.fragmentation = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.gratuitous_arp = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.incoming_forwarding = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.tos_state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.tos = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.ttl = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.delayed_ack = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.tcp_nagle = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.tcp_wsf_state = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.tcp_wsf = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.tcp_timer_scale = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.tcp_timestamp = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.redirect = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.def_task_mgmt_timeout = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.header_digest = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.data_digest = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.immediate_data = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.initial_r2t = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.data_seq_inorder = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.data_pdu_inorder = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.erl = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.max_receive_data_len = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.first_burst_len = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.max_outstanding_r2t = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.max_burst_len = 0
Nov 15 01:36:33 user nova-compute[74880]: iface.chap_auth = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.bidi_chap = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.strict_login_compliance = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.discovery_auth = <empty>
Nov 15 01:36:33 user nova-compute[74880]: iface.discovery_logout = <empty>
Nov 15 01:36:33 user nova-compute[74880]: node.discovery_address = <empty>
Nov 15 01:36:33 user nova-compute[74880]: node.discovery_port = 0
Nov 15 01:36:33 user nova-compute[74880]: node.discovery_type = static
Nov 15 01:36:33 user nova-compute[74880]: node.session.initial_cmdsn = 0
Nov 15 01:36:33 user nova-compute[74880]: node.session.initial_login_retry_max = 8
Nov 15 01:36:33 user nova-compute[74880]: node.session.xmit_thread_priority = -20
Nov 15 01:36:33 user nova-compute[74880]: node.session.cmds_max = 128
Nov 15 01:36:33 user nova-compute[74880]: node.session.queue_depth = 32
Nov 15 01:36:33 user nova-compute[74880]: node.session.nr_sessions = 1
Nov 15 01:36:33 user nova-compute[74880]: node.session.auth.authmethod = CHAP
Nov 15 01:36:33 user nova-compute[74880]: node.session.auth.username = UEFwDQfR
Nov 15 01:36:33 user nova-compute[74880]: node.session.auth.password = ***
Nov 15 01:36:33 user nova-compute[74880]: node.session.auth.username_in = <empty>
Nov 15 01:36:33 user nova-compute[74880]: node.session.auth.password_in = <empty>
Nov 15 01:36:33 user nova-compute[74880]: node.session.auth.chap_algs = MD5
Nov 15 01:36:33 user nova-compute[74880]: node.session.timeo.replacement_timeout = 120
Nov 15 01:36:33 user nova-compute[74880]: node.session.err_timeo.abort_timeout = 15
Nov 15 01:36:33 user nova-compute[74880]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 01:36:33 user nova-compute[74880]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 01:36:33 user nova-compute[74880]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.FastAbort = Yes
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.InitialR2T = No
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.ImmediateData = Yes
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.MaxConnections = 1
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 01:36:33 user nova-compute[74880]: node.session.iscsi.ERL = 0
Nov 15 01:36:33 user nova-compute[74880]: node.session.scan = manual
Nov 15 01:36:33 user nova-compute[74880]: node.session.reopen_max = 0
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].address = 172.16.0.220
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].port = 3260
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].startup = manual
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].tcp.window_size = 524288
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].tcp.type_of_service = 0
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].timeo.logout_timeout = 15
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].timeo.login_timeout = 15
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].timeo.auth_timeout = 45
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].iscsi.DataDigest = None
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].iscsi.IFMarker = No
Nov 15 01:36:33 user nova-compute[74880]: node.conn[0].iscsi.OFMarker = No
Nov 15 01:36:33 user nova-compute[74880]: # END RECORD
Nov 15 01:36:33 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43059503-30d2-4333-acf7-6936e74e4d6c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[706172f5-9429-46a0-9bec-1d7d1beee4f1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEFwDQfR {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEFwDQfR" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b39f22-01fc-4aa2-a6e0-35d314fe5957]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEFwDQfR'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd320b-adba-40e2-bf2f-17ef2fee2cac]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff2995-675d-4cd6-8cec-594b5e31e8eb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:33 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:33 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:33 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] HCTL ('34', '0', '0', 0) found on session 51 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809f38b-bd6d-4658-b4ee-3705327da092]: (4, ('0 0 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Searching for a device in session 51 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '26233366361623965', 'path': '/dev/sdc'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233366361623965', 'path': '/dev/sdc'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982436322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982436322',id=44,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-wkc5pu6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:34:55Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=f126fb29-d56c-4f6b-9b79-a4944e5ce618,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "vif_mac": "fa:16:3e:59:f3:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "vif_mac": "fa:16:3e:59:f3:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.objects.instance [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'pci_devices' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.objects.base [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Object Instance<f126fb29-d56c-4f6b-9b79-a4944e5ce618> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:36:33 user nova-compute[74880]:   <uuid>f126fb29-d56c-4f6b-9b79-a4944e5ce618</uuid>
Nov 15 01:36:33 user nova-compute[74880]:   <name>instance-0000002c</name>
Nov 15 01:36:33 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:36:33 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:36:33 user nova-compute[74880]:   <metadata>
Nov 15 01:36:33 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:36:33 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:36:33 user nova-compute[74880]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-982436322</nova:name>
Nov 15 01:36:33 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:36:32</nova:creationTime>
Nov 15 01:36:33 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:36:33 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:36:33 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:36:33 user nova-compute[74880]:       <nova:owner>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:user uuid="d34159a5cea6426f8e4303dbf20a99af">tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member</nova:user>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:project uuid="069cac8f31694b1abcac7d3cfaac76ed">tempest-ServerBootFromVolumeStableRescueTest-330586401</nova:project>
Nov 15 01:36:33 user nova-compute[74880]:       </nova:owner>
Nov 15 01:36:33 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:36:33 user nova-compute[74880]:       <nova:ports>
Nov 15 01:36:33 user nova-compute[74880]:         <nova:port uuid="4eaf3540-8ef3-4f5d-af12-a9afb7b75b27">
Nov 15 01:36:33 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 01:36:33 user nova-compute[74880]:         </nova:port>
Nov 15 01:36:33 user nova-compute[74880]:       </nova:ports>
Nov 15 01:36:33 user nova-compute[74880]:     </nova:instance>
Nov 15 01:36:33 user nova-compute[74880]:   </metadata>
Nov 15 01:36:33 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:36:33 user nova-compute[74880]:     <system>
Nov 15 01:36:33 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:36:33 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:36:33 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:36:33 user nova-compute[74880]:       <entry name="serial">f126fb29-d56c-4f6b-9b79-a4944e5ce618</entry>
Nov 15 01:36:33 user nova-compute[74880]:       <entry name="uuid">f126fb29-d56c-4f6b-9b79-a4944e5ce618</entry>
Nov 15 01:36:33 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:36:33 user nova-compute[74880]:     </system>
Nov 15 01:36:33 user nova-compute[74880]:   </sysinfo>
Nov 15 01:36:33 user nova-compute[74880]:   <os>
Nov 15 01:36:33 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:36:33 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:36:33 user nova-compute[74880]:   </os>
Nov 15 01:36:33 user nova-compute[74880]:   <features>
Nov 15 01:36:33 user nova-compute[74880]:     <acpi/>
Nov 15 01:36:33 user nova-compute[74880]:     <apic/>
Nov 15 01:36:33 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:36:33 user nova-compute[74880]:   </features>
Nov 15 01:36:33 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:36:33 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:36:33 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:36:33 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:36:33 user nova-compute[74880]:   </clock>
Nov 15 01:36:33 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:36:33 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:36:33 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:36:33 user nova-compute[74880]:   </cpu>
Nov 15 01:36:33 user nova-compute[74880]:   <devices>
Nov 15 01:36:33 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:36:33 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:33 user nova-compute[74880]:       <source dev="/dev/sdc"/>
Nov 15 01:36:33 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:36:33 user nova-compute[74880]:       <serial>1c8ec99f-862b-4b1d-b911-b82c051d0c23</serial>
Nov 15 01:36:33 user nova-compute[74880]:     </disk>
Nov 15 01:36:33 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:36:33 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:36:33 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue"/>
Nov 15 01:36:33 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:36:33 user nova-compute[74880]:       <boot order="1"/>
Nov 15 01:36:33 user nova-compute[74880]:     </disk>
Nov 15 01:36:33 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:36:33 user nova-compute[74880]:       <mac address="fa:16:3e:59:f3:ef"/>
Nov 15 01:36:33 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:36:33 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:36:33 user nova-compute[74880]:       <target dev="tap4eaf3540-8e"/>
Nov 15 01:36:33 user nova-compute[74880]:     </interface>
Nov 15 01:36:33 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:36:33 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/console.log" append="off"/>
Nov 15 01:36:33 user nova-compute[74880]:     </serial>
Nov 15 01:36:33 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:36:33 user nova-compute[74880]:     <video>
Nov 15 01:36:33 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:36:33 user nova-compute[74880]:     </video>
Nov 15 01:36:33 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:36:33 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:36:33 user nova-compute[74880]:     </rng>
Nov 15 01:36:33 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:36:33 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:36:33 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:36:33 user nova-compute[74880]:     </memballoon>
Nov 15 01:36:33 user nova-compute[74880]:   </devices>
Nov 15 01:36:33 user nova-compute[74880]: </domain>
Nov 15 01:36:33 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:36:33 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance destroyed successfully.
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:36:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] No VIF found with MAC fa:16:3e:59:f3:ef, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-605d8387-e58d-4db3-915c-7b08681db044 req-842a689f-0075-4077-8554-2c80c69a7dcf service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-605d8387-e58d-4db3-915c-7b08681db044 req-842a689f-0075-4077-8554-2c80c69a7dcf service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-605d8387-e58d-4db3-915c-7b08681db044 req-842a689f-0075-4077-8554-2c80c69a7dcf service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-605d8387-e58d-4db3-915c-7b08681db044 req-842a689f-0075-4077-8554-2c80c69a7dcf service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-605d8387-e58d-4db3-915c-7b08681db044 req-842a689f-0075-4077-8554-2c80c69a7dcf service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:36:34 user nova-compute[74880]: WARNING nova.compute.manager [req-605d8387-e58d-4db3-915c-7b08681db044 req-842a689f-0075-4077-8554-2c80c69a7dcf service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state active and task_state rescuing.
Nov 15 01:36:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-4c87eaf4-0586-4d95-82ec-b4b0716336ba tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:36:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-6446cfad-349e-4760-b30e-6e1a219b0f3d req-cdfe8800-bac6-47f4-92c7-e2c86e3c4a80 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:36:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6446cfad-349e-4760-b30e-6e1a219b0f3d req-cdfe8800-bac6-47f4-92c7-e2c86e3c4a80 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6446cfad-349e-4760-b30e-6e1a219b0f3d req-cdfe8800-bac6-47f4-92c7-e2c86e3c4a80 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6446cfad-349e-4760-b30e-6e1a219b0f3d req-cdfe8800-bac6-47f4-92c7-e2c86e3c4a80 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-6446cfad-349e-4760-b30e-6e1a219b0f3d req-cdfe8800-bac6-47f4-92c7-e2c86e3c4a80 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:36:36 user nova-compute[74880]: WARNING nova.compute.manager [req-6446cfad-349e-4760-b30e-6e1a219b0f3d req-cdfe8800-bac6-47f4-92c7-e2c86e3c4a80 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state rescued and task_state None.
Nov 15 01:36:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:39 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33737552-0ea5-47c5-9598-21ae37097a20 is timed out.
Nov 15 01:36:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully detached device vdb from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the live domain config.
Nov 15 01:36:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrvBUVHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:39 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80976feb-ba1a-4700-8b1b-b6bc9e34f85e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:36:39 user nova-compute[74880]: No targets found.
Nov 15 01:36:39 user nova-compute[74880]: iSNS:
Nov 15 01:36:39 user nova-compute[74880]: No targets found.
Nov 15 01:36:39 user nova-compute[74880]: STATIC:
Nov 15 01:36:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2
Nov 15 01:36:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b
Nov 15 01:36:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d
Nov 15 01:36:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:36:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:36:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:36:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:39 user nova-compute[74880]: FIRMWARE:
Nov 15 01:36:39 user nova-compute[74880]: No targets found.
Nov 15 01:36:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:36:39 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:36:39 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc9935-97df-4a8d-b4bb-a84d279b28bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa29a969-1b1a-4b1c-b995-f8e1a92c52b3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:39 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f95138255a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2'): ({'sde'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Removing single pathed devices sde {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.083s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db39fe-7d6d-4fcd-9f26-053f19e80033]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[695cab92-15cb-4148-947f-c58f8c3d1dd5]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flushing IO for device /dev/sde {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb13680-aedf-4232-b317-533b2e952700]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae77435-2dfa-45af-9b42-4041e22dafff]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf096a-1ce2-4bb9-9acf-d06e92cadde1]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d661e36-5ad3-471d-b7af-d589193c911b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260]
Nov 15 01:36:40 user nova-compute[74880]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2, portal: 172.16.0.220,3260] successful.
Nov 15 01:36:40 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:758d2560-0210-441a-abc7-fcda887957b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5bc470-81d7-4a30-bdcf-38be19ffea5f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== disconnect_volume: return (400ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG nova.objects.instance [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-99b41289-42c9-4e35-91a9-7d3b19339346 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:41 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 035f18be-0875-4a41-b38e-3f27362b3b86 is timed out.
Nov 15 01:36:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully detached device vdb from instance 035f18be-0875-4a41-b38e-3f27362b3b86 from the live domain config.
Nov 15 01:36:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEIHRChp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:36:41 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[719f123c-ddf3-484b-8c3e-7f1580e18849]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:36:41 user nova-compute[74880]: No targets found.
Nov 15 01:36:41 user nova-compute[74880]: iSNS:
Nov 15 01:36:41 user nova-compute[74880]: No targets found.
Nov 15 01:36:41 user nova-compute[74880]: STATIC:
Nov 15 01:36:41 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b
Nov 15 01:36:41 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:41 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:41 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d
Nov 15 01:36:41 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:41 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:41 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:36:41 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:41 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:41 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:36:41 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:41 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:41 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:36:41 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:36:41 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:36:41 user nova-compute[74880]: FIRMWARE:
Nov 15 01:36:41 user nova-compute[74880]: No targets found.
Nov 15 01:36:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:36:41 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:36:41 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b22b66-f12f-4f82-a0c1-7f1408a24f37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8925146-6a00-42cc-9804-16965fa9ac14]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:36:41 user nova-compute[74880]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d (non-flash)
Nov 15 01:36:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d0729bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d'): ({'sdg'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Removing single pathed devices sdg {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c0011-3d7e-4e1b-9dee-86bea21d4298]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de8c1c8-3da8-4657-97b4-08be66cec0c4]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flushing IO for device /dev/sdg {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec71c10f-0b8b-49e1-bb85-d5bed76a75fb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab3f1c-2abc-4029-9e75-75803d39bc7d]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] SCSI volumes sdg have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4701e55-eca1-49e3-ae88-6aefc9f73c17]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[382b7149-5b50-4f49-a5ab-3e3fe5f97cbf]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260]
Nov 15 01:36:41 user nova-compute[74880]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d, portal: 172.16.0.220,3260] successful.
Nov 15 01:36:41 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdfa43a-d8e0-4897-9088-affc9172359d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1942487-53de-4091-80c8-5ee8b0fa1986]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== disconnect_volume: return (334ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:41 user nova-compute[74880]: INFO nova.compute.manager [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Detaching volume a1c7aecf-d690-4d4f-b873-75324302d75b
Nov 15 01:36:41 user nova-compute[74880]: INFO nova.virt.block_device [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Attempting to driver detach volume a1c7aecf-d690-4d4f-b873-75324302d75b from mountpoint /dev/vdc
Nov 15 01:36:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Attempting to detach device vdc from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:36:41 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:41 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:36:41 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:36:41 user nova-compute[74880]:   <serial>a1c7aecf-d690-4d4f-b873-75324302d75b</serial>
Nov 15 01:36:41 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 01:36:41 user nova-compute[74880]: </disk>
Nov 15 01:36:41 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:36:41 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully detached device vdc from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the persistent domain config.
Nov 15 01:36:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:36:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:36:41 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:36:41 user nova-compute[74880]:   <source dev="/dev/sdf"/>
Nov 15 01:36:41 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:36:41 user nova-compute[74880]:   <serial>a1c7aecf-d690-4d4f-b873-75324302d75b</serial>
Nov 15 01:36:41 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 01:36:41 user nova-compute[74880]: </disk>
Nov 15 01:36:41 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:36:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:36:42 user nova-compute[74880]: DEBUG nova.objects.instance [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid 035f18be-0875-4a41-b38e-3f27362b3b86 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:36:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-37bb6447-151b-4fa4-a7bd-9c2e6e84be0c tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.810s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:36:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:36:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:36:57 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [{"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-8bc89cdc-b0df-44cb-87fe-daefba1fea88" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:36:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:37:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:37:00 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:37:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8184MB free_disk=25.104938507080078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 33737552-0ea5-47c5-9598-21ae37097a20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 035f18be-0875-4a41-b38e-3f27362b3b86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance cb603a34-9aac-486e-901f-3969bfb4e0c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:02 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 33737552-0ea5-47c5-9598-21ae37097a20 is timed out.
Nov 15 01:37:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully detached device vdc from instance 33737552-0ea5-47c5-9598-21ae37097a20 from the live domain config.
Nov 15 01:37:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLqbIPnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:37:02 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e97d45b-8764-4735-a20c-a38cfa63eeab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:37:02 user nova-compute[74880]: No targets found.
Nov 15 01:37:02 user nova-compute[74880]: iSNS:
Nov 15 01:37:02 user nova-compute[74880]: No targets found.
Nov 15 01:37:02 user nova-compute[74880]: STATIC:
Nov 15 01:37:02 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b
Nov 15 01:37:02 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:02 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:02 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:37:02 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:02 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:02 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:37:02 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:02 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:02 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:37:02 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:02 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:02 user nova-compute[74880]: FIRMWARE:
Nov 15 01:37:02 user nova-compute[74880]: No targets found.
Nov 15 01:37:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:37:02 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:37:02 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f630f-a078-4019-97d7-7861aef1bfae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[54adbfea-1581-4dd8-b94e-2750c7eef14a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:02 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:02 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:37:02 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:37:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:02 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:02 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:37:02 user nova-compute[74880]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b (non-flash)
Nov 15 01:37:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06c8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5808bb-124f-4c38-8d3c-a3563aa16adb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f240c4a9-e603-44f9-9e7d-efed5107d83a]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2955f9-a913-4514-91e2-899a6e638297]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6781c68e-1c8f-48bb-abfa-b7c016359915]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984424b-0a2f-419c-a7ec-114fd8b9cfda]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f796431-b546-4cc9-8b05-84861335aaa2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260]
Nov 15 01:37:02 user nova-compute[74880]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b, portal: 172.16.0.220,3260] successful.
Nov 15 01:37:02 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c7aecf-d690-4d4f-b873-75324302d75b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3f5e6-ed3d-4aff-ac34-85ba504c4aaf]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] <== disconnect_volume: return (339ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:37:03 user nova-compute[74880]: DEBUG nova.objects.instance [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'flavor' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-16908367-bc8e-48b5-ad40-ddcf1a8c9889 tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:04 user nova-compute[74880]: INFO nova.compute.manager [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Terminating instance
Nov 15 01:37:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d20a39d-829a-4c88-8aca-f4ab0868eed3 req-10ca7b2e-73a0-49fb-9b3a-2a8a6058c2f8 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-vif-unplugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d20a39d-829a-4c88-8aca-f4ab0868eed3 req-10ca7b2e-73a0-49fb-9b3a-2a8a6058c2f8 service nova] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d20a39d-829a-4c88-8aca-f4ab0868eed3 req-10ca7b2e-73a0-49fb-9b3a-2a8a6058c2f8 service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d20a39d-829a-4c88-8aca-f4ab0868eed3 req-10ca7b2e-73a0-49fb-9b3a-2a8a6058c2f8 service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d20a39d-829a-4c88-8aca-f4ab0868eed3 req-10ca7b2e-73a0-49fb-9b3a-2a8a6058c2f8 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] No waiting events found dispatching network-vif-unplugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d20a39d-829a-4c88-8aca-f4ab0868eed3 req-10ca7b2e-73a0-49fb-9b3a-2a8a6058c2f8 service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-vif-unplugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:37:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Instance destroyed successfully.
Nov 15 01:37:05 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lazy-loading 'resources' on Instance uuid 33737552-0ea5-47c5-9598-21ae37097a20 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-541850427',display_name='tempest-AttachVolumeTestJSON-server-541850427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-541850427',id=42,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBWMksVRje4aC/pQXvXTSETMLEaJMq3AJioLh6D2vvsJFx17376JDOGRiNa4l1FyR/YlWh7FmB1uws9u/wxS7/xwQeJj42lMvQmspKTamPL74chIauBlJpcDAgK9l33OA==',key_name='tempest-keypair-323121258',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ad971c8d358435095c37d13aac7a30c',ramdisk_id='',reservation_id='r-3r4fklub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609488545',owner_user_name='tempest-AttachVolumeTestJSON-1609488545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:34:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66ea86fccfa749a6a52ac67af682af26',uuid=33737552-0ea5-47c5-9598-21ae37097a20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converting VIF {"id": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "address": "fa:16:3e:dd:96:9e", "network": {"id": "c29edacc-8292-4b60-b069-28ec895f9923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-227111313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad971c8d358435095c37d13aac7a30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93fa07e7-dd", "ovs_interfaceid": "93fa07e7-dd3e-4214-b4b9-7ffba072b645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG os_vif [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93fa07e7-dd, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e5d4a6b-b64c-459d-b544-a7215e9adc54) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:05 user nova-compute[74880]: INFO os_vif [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=93fa07e7-dd3e-4214-b4b9-7ffba072b645,network=Network(c29edacc-8292-4b60-b069-28ec895f9923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93fa07e7-dd')
Nov 15 01:37:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Deleting instance files /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20_del
Nov 15 01:37:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Deletion of /opt/stack/data/nova/instances/33737552-0ea5-47c5-9598-21ae37097a20_del complete
Nov 15 01:37:05 user nova-compute[74880]: INFO nova.compute.manager [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 01:37:05 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:37:05 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:06 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Took 0.74 seconds to deallocate network for instance.
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-aaba1645-dd55-4c91-846e-ad5970b4f590 req-436610a8-baad-44ca-9b1b-f392eaad5e1a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-vif-deleted-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:06 user nova-compute[74880]: INFO nova.compute.manager [req-aaba1645-dd55-4c91-846e-ad5970b4f590 req-436610a8-baad-44ca-9b1b-f392eaad5e1a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Neutron deleted interface 93fa07e7-dd3e-4214-b4b9-7ffba072b645; detaching it from the instance and deleting it from the info cache
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-aaba1645-dd55-4c91-846e-ad5970b4f590 req-436610a8-baad-44ca-9b1b-f392eaad5e1a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-aaba1645-dd55-4c91-846e-ad5970b4f590 req-436610a8-baad-44ca-9b1b-f392eaad5e1a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Detach interface failed, port_id=93fa07e7-dd3e-4214-b4b9-7ffba072b645, reason: Instance 33737552-0ea5-47c5-9598-21ae37097a20 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:06 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Deleted allocations for instance 33737552-0ea5-47c5-9598-21ae37097a20
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f4c42d8d-f9ac-41cd-b5b9-c73dce794f5e tempest-AttachVolumeTestJSON-1609488545 tempest-AttachVolumeTestJSON-1609488545-project-member] Lock "33737552-0ea5-47c5-9598-21ae37097a20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-2057b4b8-50ef-4100-b481-1d39c1c8b883 req-af9f23ae-3950-4f55-9306-7689e126178a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received event network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2057b4b8-50ef-4100-b481-1d39c1c8b883 req-af9f23ae-3950-4f55-9306-7689e126178a service nova] Acquiring lock "33737552-0ea5-47c5-9598-21ae37097a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2057b4b8-50ef-4100-b481-1d39c1c8b883 req-af9f23ae-3950-4f55-9306-7689e126178a service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2057b4b8-50ef-4100-b481-1d39c1c8b883 req-af9f23ae-3950-4f55-9306-7689e126178a service nova] Lock "33737552-0ea5-47c5-9598-21ae37097a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-2057b4b8-50ef-4100-b481-1d39c1c8b883 req-af9f23ae-3950-4f55-9306-7689e126178a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] No waiting events found dispatching network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:06 user nova-compute[74880]: WARNING nova.compute.manager [req-2057b4b8-50ef-4100-b481-1d39c1c8b883 req-af9f23ae-3950-4f55-9306-7689e126178a service nova] [instance: 33737552-0ea5-47c5-9598-21ae37097a20] Received unexpected event network-vif-plugged-93fa07e7-dd3e-4214-b4b9-7ffba072b645 for instance with vm_state deleted and task_state None.
Nov 15 01:37:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:10 user nova-compute[74880]: INFO nova.compute.manager [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Terminating instance
Nov 15 01:37:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-b54e35e5-0c43-4132-9aa7-da9d2346b6da req-787386b6-1586-4d50-ac41-39c873fd94f9 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-vif-unplugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b54e35e5-0c43-4132-9aa7-da9d2346b6da req-787386b6-1586-4d50-ac41-39c873fd94f9 service nova] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b54e35e5-0c43-4132-9aa7-da9d2346b6da req-787386b6-1586-4d50-ac41-39c873fd94f9 service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b54e35e5-0c43-4132-9aa7-da9d2346b6da req-787386b6-1586-4d50-ac41-39c873fd94f9 service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-b54e35e5-0c43-4132-9aa7-da9d2346b6da req-787386b6-1586-4d50-ac41-39c873fd94f9 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] No waiting events found dispatching network-vif-unplugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-b54e35e5-0c43-4132-9aa7-da9d2346b6da req-787386b6-1586-4d50-ac41-39c873fd94f9 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-vif-unplugged-81c84dea-f798-4fff-9834-4ccb6539b398 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Instance destroyed successfully.
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'resources' on Instance uuid 035f18be-0875-4a41-b38e-3f27362b3b86 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-531757073',display_name='tempest-AttachVolumeNegativeTest-server-531757073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-531757073',id=43,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5T4F0o3BaOQsXRVIh161sl70TEs8u6ue/wevSEdndfAEJIEPjcX+hOsj34D2UZBSb3/S/2lvAat+7xsdGfK6cUnLKVMDPEo/Ek/GaBSUKdssDn7PtER12EbXZNzrGkEw==',key_name='tempest-keypair-924989542',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:34:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-00xlct0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=035f18be-0875-4a41-b38e-3f27362b3b86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "81c84dea-f798-4fff-9834-4ccb6539b398", "address": "fa:16:3e:2b:9c:8c", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81c84dea-f7", "ovs_interfaceid": "81c84dea-f798-4fff-9834-4ccb6539b398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG os_vif [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81c84dea-f7, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52bbcfa1-64ef-4b61-a02a-f1a51503c323) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:11 user nova-compute[74880]: INFO os_vif [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=81c84dea-f798-4fff-9834-4ccb6539b398,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81c84dea-f7')
Nov 15 01:37:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Deleting instance files /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86_del
Nov 15 01:37:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Deletion of /opt/stack/data/nova/instances/035f18be-0875-4a41-b38e-3f27362b3b86_del complete
Nov 15 01:37:11 user nova-compute[74880]: INFO nova.compute.manager [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 01:37:11 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-changed-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Refreshing instance network info cache due to event network-changed-db413f7d-e75f-4224-841f-45c471a54f6c. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] Acquiring lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] Acquired lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:37:11 user nova-compute[74880]: DEBUG nova.network.neutron [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Refreshing network info cache for port db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:12 user nova-compute[74880]: INFO nova.compute.manager [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Terminating instance
Nov 15 01:37:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG nova.network.neutron [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updated VIF entry in instance network info cache for port db413f7d-e75f-4224-841f-45c471a54f6c. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG nova.network.neutron [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updating instance_info_cache with network_info: [{"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9d7b8406-d358-4acd-88b8-82d942fb0547 req-6f30b3eb-e6f7-4993-8fad-226f8514da47 service nova] Releasing lock "refresh_cache-cb603a34-9aac-486e-901f-3969bfb4e0c1" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-a3e17ef4-a43c-4d1f-a5d9-0c546db7d884 req-8eff6df0-6d64-444e-98a6-fa0ce39fb347 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-vif-unplugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a3e17ef4-a43c-4d1f-a5d9-0c546db7d884 req-8eff6df0-6d64-444e-98a6-fa0ce39fb347 service nova] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a3e17ef4-a43c-4d1f-a5d9-0c546db7d884 req-8eff6df0-6d64-444e-98a6-fa0ce39fb347 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-a3e17ef4-a43c-4d1f-a5d9-0c546db7d884 req-8eff6df0-6d64-444e-98a6-fa0ce39fb347 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-a3e17ef4-a43c-4d1f-a5d9-0c546db7d884 req-8eff6df0-6d64-444e-98a6-fa0ce39fb347 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] No waiting events found dispatching network-vif-unplugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-a3e17ef4-a43c-4d1f-a5d9-0c546db7d884 req-8eff6df0-6d64-444e-98a6-fa0ce39fb347 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-vif-unplugged-db413f7d-e75f-4224-841f-45c471a54f6c for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:13 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Took 1.30 seconds to deallocate network for instance.
Nov 15 01:37:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Instance destroyed successfully.
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'resources' on Instance uuid cb603a34-9aac-486e-901f-3969bfb4e0c1 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-23955975',display_name='tempest-TestVolumeBootPattern-server-23955975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-23955975',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:35:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-i800xxs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:35:31Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=cb603a34-9aac-486e-901f-3969bfb4e0c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "db413f7d-e75f-4224-841f-45c471a54f6c", "address": "fa:16:3e:d6:7d:8f", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb413f7d-e7", "ovs_interfaceid": "db413f7d-e75f-4224-841f-45c471a54f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_vif [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb413f7d-e7, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb58a77c-85ee-4324-831b-9e44f79a6e7f) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e9acdef-1ede-4779-9581-8bfb5c280132 req-b646ce83-c1e9-47e6-a216-65216c61f57e service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e9acdef-1ede-4779-9581-8bfb5c280132 req-b646ce83-c1e9-47e6-a216-65216c61f57e service nova] Acquiring lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e9acdef-1ede-4779-9581-8bfb5c280132 req-b646ce83-c1e9-47e6-a216-65216c61f57e service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4e9acdef-1ede-4779-9581-8bfb5c280132 req-b646ce83-c1e9-47e6-a216-65216c61f57e service nova] Lock "035f18be-0875-4a41-b38e-3f27362b3b86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-4e9acdef-1ede-4779-9581-8bfb5c280132 req-b646ce83-c1e9-47e6-a216-65216c61f57e service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] No waiting events found dispatching network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:13 user nova-compute[74880]: WARNING nova.compute.manager [req-4e9acdef-1ede-4779-9581-8bfb5c280132 req-b646ce83-c1e9-47e6-a216-65216c61f57e service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received unexpected event network-vif-plugged-81c84dea-f798-4fff-9834-4ccb6539b398 for instance with vm_state deleted and task_state None.
Nov 15 01:37:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:13 user nova-compute[74880]: INFO os_vif [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=db413f7d-e75f-4224-841f-45c471a54f6c,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb413f7d-e7')
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:37:13 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9392e83c-7a36-4962-abd8-272f26bd6dbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:37:13 user nova-compute[74880]: No targets found.
Nov 15 01:37:13 user nova-compute[74880]: iSNS:
Nov 15 01:37:13 user nova-compute[74880]: No targets found.
Nov 15 01:37:13 user nova-compute[74880]: STATIC:
Nov 15 01:37:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:37:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:37:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:13 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:37:13 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:37:13 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:37:13 user nova-compute[74880]: FIRMWARE:
Nov 15 01:37:13 user nova-compute[74880]: No targets found.
Nov 15 01:37:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:37:13 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:37:13 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f922c-d546-4395-aa48-ba7cdf27c4d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7611ccc1-ab99-496e-807c-3d6fc543602c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:13 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:13 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:37:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:13 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:13 user nova-compute[74880]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:37:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01f0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4a5df-ae42-430c-9996-07f32c36b8f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a73fa9-77a6-4c38-937e-ade70f9d620a]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d029d1-d408-4626-8d8c-dc917b6d77a4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a782de7-45cd-492a-bca9-fde285c0df3e]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Deleted allocations for instance 035f18be-0875-4a41-b38e-3f27362b3b86
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea25cb-0125-4b5e-bb39-7e7f4771110d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef17cc0-90de-45c0-a2a4-5b9fbda6912d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]
Nov 15 01:37:13 user nova-compute[74880]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.
Nov 15 01:37:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3797fbd5-fc75-4390-818b-fffce873e2f8 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "035f18be-0875-4a41-b38e-3f27362b3b86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790a236-9fa8-4dea-b446-65ec323dcb0c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== disconnect_volume: return (308ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:37:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Deleting instance files /opt/stack/data/nova/instances/cb603a34-9aac-486e-901f-3969bfb4e0c1_del
Nov 15 01:37:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Deletion of /opt/stack/data/nova/instances/cb603a34-9aac-486e-901f-3969bfb4e0c1_del complete
Nov 15 01:37:13 user nova-compute[74880]: INFO nova.compute.manager [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 15 01:37:13 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:37:13 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:37:14 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:14 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Took 0.77 seconds to deallocate network for instance.
Nov 15 01:37:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] [instance: 035f18be-0875-4a41-b38e-3f27362b3b86] Received event network-vif-deleted-81c84dea-f798-4fff-9834-4ccb6539b398 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] Acquiring lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] No waiting events found dispatching network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:14 user nova-compute[74880]: WARNING nova.compute.manager [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received unexpected event network-vif-plugged-db413f7d-e75f-4224-841f-45c471a54f6c for instance with vm_state active and task_state deleting.
Nov 15 01:37:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-10de9f55-3e44-4a18-a98f-789273cc68aa req-468e3abd-994a-416c-b2ce-dce18efab210 service nova] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Received event network-vif-deleted-db413f7d-e75f-4224-841f-45c471a54f6c {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:15 user nova-compute[74880]: INFO nova.compute.manager [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cb603a34-9aac-486e-901f-3969bfb4e0c1] Took 0.71 seconds to detach 1 volumes for instance.
Nov 15 01:37:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:15 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:37:15 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:37:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:15 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Deleted allocations for instance cb603a34-9aac-486e-901f-3969bfb4e0c1
Nov 15 01:37:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8ad85632-4a7f-4a92-b1c2-b502cf048959 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cb603a34-9aac-486e-901f-3969bfb4e0c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:37:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:37:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:37:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:31 user nova-compute[74880]: INFO nova.compute.manager [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Unshelving
Nov 15 01:37:31 user nova-compute[74880]: INFO nova.virt.block_device [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Booting with volume 47ecc078-07a0-4c75-9877-835f1419bc40 at /dev/vdc
Nov 15 01:37:31 user nova-compute[74880]: DEBUG os_brick.utils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4145edb8-3eeb-4b97-859f-9efcfe8d4f12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a975b80-8e59-4028-bce5-6485b4af8158]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[efae9e37-e0f7-496f-a002-f857ceb1d44f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ac13eb-df5c-421c-9431-fc9e027fe41e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:37:31 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:37:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe188f4-f30b-4f45-b480-a2e5b37c7ad0]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG os_brick.utils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:37:31 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating existing volume attachment record: 76a85b07-7aa8-4b93-9f3d-3b4b6eb27455 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:37:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'pci_requests' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'numa_topology' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:37:36 user nova-compute[74880]: INFO nova.compute.claims [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Claim successful on node user
Nov 15 01:37:36 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:37:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:36 user nova-compute[74880]: INFO nova.network.neutron [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating port ccf3a5af-da88-48ce-afde-22d3c746c687 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.compute.manager [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing instance network info cache due to event network-changed-ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] Acquiring lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:37:37 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Creating image(s)
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] Acquired lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.network.neutron [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Refreshing network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG nova.objects.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<8361002e-bba9-454c-addc-e740d02b6a4d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "11cf285a8523999d99b8182b419ab605e7052b0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "11cf285a8523999d99b8182b419ab605e7052b0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG nova.virt.images [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] 7dfbff4b-f98e-4834-b3fa-7851b0a93926 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.part /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updated VIF entry in instance network info cache for port ccf3a5af-da88-48ce-afde-22d3c746c687. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG nova.network.neutron [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-abd601f1-8ff6-434a-a517-6df746c0b53a req-5b33ba62-fa46-4f68-8f86-b27eaf7e7518 service nova] Releasing lock "refresh_cache-8361002e-bba9-454c-addc-e740d02b6a4d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:37:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.part /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.converted" returned: 0 in 0.281s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "11cf285a8523999d99b8182b419ab605e7052b0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.487s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "11cf285a8523999d99b8182b419ab605e7052b0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "11cf285a8523999d99b8182b419ab605e7052b0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b,backing_fmt=raw /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b,backing_fmt=raw /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk 1073741824" returned: 0 in 0.052s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "11cf285a8523999d99b8182b419ab605e7052b0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b --force-share --output=json" returned: 0 in 0.165s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'migration_context' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:39 user nova-compute[74880]: DEBUG nova.objects.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<8361002e-bba9-454c-addc-e740d02b6a4d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:37:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Rebasing disk image.
Nov 15 01:37:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 -F raw /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 -F raw /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk" returned: 0 in 1.978s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Ensure instance console log exists: /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Start _get_guest_xml network_info=[{"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='33041675793524b7dcb059a67efc042c',container_format='bare',created_at=2023-11-15T01:35:39Z,direct_url=<?>,disk_format='qcow2',id=7dfbff4b-f98e-4834-b3fa-7851b0a93926,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2143680415-shelved',owner='b889c4a61c654c9b90461d7c8f39473f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T01:35:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxHZntAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8361002e-bba9-454c-addc-e740d02b6a4d', 'attached_at': '', 'detached_at': '', 'volume_id': '47ecc078-07a0-4c75-9877-835f1419bc40', 'serial': '47ecc078-07a0-4c75-9877-835f1419bc40'}, 'mount_device': '/dev/vdc', 'attachment_id': '76a85b07-7aa8-4b93-9f3d-3b4b6eb27455', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:37:41 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:37:42 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='33041675793524b7dcb059a67efc042c',container_format='bare',created_at=2023-11-15T01:35:39Z,direct_url=<?>,disk_format='qcow2',id=7dfbff4b-f98e-4834-b3fa-7851b0a93926,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2143680415-shelved',owner='b889c4a61c654c9b90461d7c8f39473f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T01:35:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.objects.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<8361002e-bba9-454c-addc-e740d02b6a4d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxHZntAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:37:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:37:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:37:42 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8489e59-7d47-456a-b436-5fdd3568ee9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:37:42 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fe7aef-f8ac-4b41-93db-b45541b3e785]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40] added
Nov 15 01:37:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c06ae5-e021-48f5-a040-9860873d6ee3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a03653-ea47-4a0b-b6d6-75f0a75e79ac]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hxHZntAu {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hxHZntAu" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8b081e-3e3c-4afb-a0a2-6c595c469c87]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hxHZntAu'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd70efe-d5f3-407c-9bfc-597004d84078]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70fdfc2-5eea-4330-861c-46f6a4316ca1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:42 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:42 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[89355edd-518d-4685-9fae-678598694c2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260]
Nov 15 01:37:42 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260] successful.
Nov 15 01:37:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5190eedc-92e3-4362-85ae-0d15eb77cef3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b6909-ddf1-447e-b4d4-0d957a4e3447]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:42 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:42 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:37:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:37:42 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:37:42 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:37:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf920eb-da98-41d0-850c-ce9d16315cd6]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:37:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxHZntAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26330623733316661', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330623733316661', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2143680415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2143680415',id=41,image_ref='7dfbff4b-f98e-4834-b3fa-7851b0a93926',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-87033895',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:33:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-brnwyvfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member',shelved_at='2023-11-15T01:35:43.593351',shelved_host='user',shelved_image_id='7dfbff4b-f98e-4834-b3fa-7851b0a93926'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=8361002e-bba9-454c-addc-e740d02b6a4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'pci_devices' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.objects.base [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<8361002e-bba9-454c-addc-e740d02b6a4d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:37:43 user nova-compute[74880]:   <uuid>8361002e-bba9-454c-addc-e740d02b6a4d</uuid>
Nov 15 01:37:43 user nova-compute[74880]:   <name>instance-00000029</name>
Nov 15 01:37:43 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:37:43 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:37:43 user nova-compute[74880]:   <metadata>
Nov 15 01:37:43 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:37:43 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:37:43 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2143680415</nova:name>
Nov 15 01:37:43 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:37:42</nova:creationTime>
Nov 15 01:37:43 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:37:43 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:37:43 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:37:43 user nova-compute[74880]:       <nova:owner>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:user uuid="e673708299e44c4dbe871e7fd1cf0dd4">tempest-AttachVolumeShelveTestJSON-1373123325-project-member</nova:user>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:project uuid="b889c4a61c654c9b90461d7c8f39473f">tempest-AttachVolumeShelveTestJSON-1373123325</nova:project>
Nov 15 01:37:43 user nova-compute[74880]:       </nova:owner>
Nov 15 01:37:43 user nova-compute[74880]:       <nova:root type="image" uuid="7dfbff4b-f98e-4834-b3fa-7851b0a93926"/>
Nov 15 01:37:43 user nova-compute[74880]:       <nova:ports>
Nov 15 01:37:43 user nova-compute[74880]:         <nova:port uuid="ccf3a5af-da88-48ce-afde-22d3c746c687">
Nov 15 01:37:43 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 01:37:43 user nova-compute[74880]:         </nova:port>
Nov 15 01:37:43 user nova-compute[74880]:       </nova:ports>
Nov 15 01:37:43 user nova-compute[74880]:     </nova:instance>
Nov 15 01:37:43 user nova-compute[74880]:   </metadata>
Nov 15 01:37:43 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:37:43 user nova-compute[74880]:     <system>
Nov 15 01:37:43 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:37:43 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:37:43 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:37:43 user nova-compute[74880]:       <entry name="serial">8361002e-bba9-454c-addc-e740d02b6a4d</entry>
Nov 15 01:37:43 user nova-compute[74880]:       <entry name="uuid">8361002e-bba9-454c-addc-e740d02b6a4d</entry>
Nov 15 01:37:43 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:37:43 user nova-compute[74880]:     </system>
Nov 15 01:37:43 user nova-compute[74880]:   </sysinfo>
Nov 15 01:37:43 user nova-compute[74880]:   <os>
Nov 15 01:37:43 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:37:43 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:37:43 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:37:43 user nova-compute[74880]:   </os>
Nov 15 01:37:43 user nova-compute[74880]:   <features>
Nov 15 01:37:43 user nova-compute[74880]:     <acpi/>
Nov 15 01:37:43 user nova-compute[74880]:     <apic/>
Nov 15 01:37:43 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:37:43 user nova-compute[74880]:   </features>
Nov 15 01:37:43 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:37:43 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:37:43 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:37:43 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:37:43 user nova-compute[74880]:   </clock>
Nov 15 01:37:43 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:37:43 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:37:43 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:37:43 user nova-compute[74880]:   </cpu>
Nov 15 01:37:43 user nova-compute[74880]:   <devices>
Nov 15 01:37:43 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:37:43 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:37:43 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk"/>
Nov 15 01:37:43 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:37:43 user nova-compute[74880]:     </disk>
Nov 15 01:37:43 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:37:43 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:37:43 user nova-compute[74880]:       <source dev="/dev/sdd"/>
Nov 15 01:37:43 user nova-compute[74880]:       <target dev="vdc" bus="virtio"/>
Nov 15 01:37:43 user nova-compute[74880]:       <serial>47ecc078-07a0-4c75-9877-835f1419bc40</serial>
Nov 15 01:37:43 user nova-compute[74880]:     </disk>
Nov 15 01:37:43 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:37:43 user nova-compute[74880]:       <mac address="fa:16:3e:8f:de:ea"/>
Nov 15 01:37:43 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:37:43 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:37:43 user nova-compute[74880]:       <target dev="tapccf3a5af-da"/>
Nov 15 01:37:43 user nova-compute[74880]:     </interface>
Nov 15 01:37:43 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:37:43 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/console.log" append="off"/>
Nov 15 01:37:43 user nova-compute[74880]:     </serial>
Nov 15 01:37:43 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:37:43 user nova-compute[74880]:     <video>
Nov 15 01:37:43 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:37:43 user nova-compute[74880]:     </video>
Nov 15 01:37:43 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:37:43 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:37:43 user nova-compute[74880]:     </rng>
Nov 15 01:37:43 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:37:43 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:37:43 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:37:43 user nova-compute[74880]:     </memballoon>
Nov 15 01:37:43 user nova-compute[74880]:   </devices>
Nov 15 01:37:43 user nova-compute[74880]: </domain>
Nov 15 01:37:43 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2143680415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2143680415',id=41,image_ref='7dfbff4b-f98e-4834-b3fa-7851b0a93926',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-87033895',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:33:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-brnwyvfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member',shelved_at='2023-11-15T01:35:43.593351',shelved_host='user',shelved_image_id='7dfbff4b-f98e-4834-b3fa-7851b0a93926'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=8361002e-bba9-454c-addc-e740d02b6a4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG os_vif [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea0cff72-0102-5910-851a-63add59b1fc8', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf3a5af-da, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccf3a5af-da, col_values=(('qos', UUID('8e30ec79-50be-4ed7-b44f-4fa6e59b139a')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccf3a5af-da, col_values=(('external_ids', {'iface-id': 'ccf3a5af-da88-48ce-afde-22d3c746c687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:de:ea', 'vm-uuid': '8361002e-bba9-454c-addc-e740d02b6a4d'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:43 user nova-compute[74880]: INFO os_vif [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da')
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:37:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No VIF found with MAC fa:16:3e:8f:de:ea, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:37:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fd9a3f0-2a50-4ad7-b377-d143c40185e4 req-a6edb0e6-59bd-41f3-8393-0be50ad2240d service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fd9a3f0-2a50-4ad7-b377-d143c40185e4 req-a6edb0e6-59bd-41f3-8393-0be50ad2240d service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fd9a3f0-2a50-4ad7-b377-d143c40185e4 req-a6edb0e6-59bd-41f3-8393-0be50ad2240d service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7fd9a3f0-2a50-4ad7-b377-d143c40185e4 req-a6edb0e6-59bd-41f3-8393-0be50ad2240d service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-7fd9a3f0-2a50-4ad7-b377-d143c40185e4 req-a6edb0e6-59bd-41f3-8393-0be50ad2240d service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:45 user nova-compute[74880]: WARNING nova.compute.manager [req-7fd9a3f0-2a50-4ad7-b377-d143c40185e4 req-a6edb0e6-59bd-41f3-8393-0be50ad2240d service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 01:37:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:37:47 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance spawned successfully.
Nov 15 01:37:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-2f96c9b4-c6e1-4661-9da7-4e1064dbe6b8 req-74c4f499-5556-4454-89af-6af5c723068f service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2f96c9b4-c6e1-4661-9da7-4e1064dbe6b8 req-74c4f499-5556-4454-89af-6af5c723068f service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2f96c9b4-c6e1-4661-9da7-4e1064dbe6b8 req-74c4f499-5556-4454-89af-6af5c723068f service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2f96c9b4-c6e1-4661-9da7-4e1064dbe6b8 req-74c4f499-5556-4454-89af-6af5c723068f service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG nova.compute.manager [req-2f96c9b4-c6e1-4661-9da7-4e1064dbe6b8 req-74c4f499-5556-4454-89af-6af5c723068f service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:37:47 user nova-compute[74880]: WARNING nova.compute.manager [req-2f96c9b4-c6e1-4661-9da7-4e1064dbe6b8 req-74c4f499-5556-4454-89af-6af5c723068f service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 01:37:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2a1d957c-12e6-4fe5-bfdc-c773c82aeb1c tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.139s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:37:54 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:37:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:37:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:37:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:37:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updating instance_info_cache with network_info: [{"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-9beee7a8-c7eb-45bd-8080-a802365f0029" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:37:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:38:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:38:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=25.133068084716797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8361002e-bba9-454c-addc-e740d02b6a4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:38:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:38:02 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:38:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:38:02 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:38:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:38:04 user nova-compute[74880]: INFO nova.compute.claims [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Claim successful on node user
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:38:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.policy [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '484f6e472b2c4cb588dfab3cc9d3932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c2385409b4f5080bf3d81430ddbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:38:04 user nova-compute[74880]: INFO nova.virt.block_device [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Booting with volume 03779a9c-ae26-4476-9234-ec2884c41b93 at /dev/vda
Nov 15 01:38:04 user nova-compute[74880]: DEBUG os_brick.utils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3c2eed-c07b-400e-ae35-7241543e38fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[506d3f3d-f0a1-4565-8261-a220d39740f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0393aa69-0c79-414b-b525-a1b08ab7285b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b697987-3b04-4d6b-972c-a1688ebfa9f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:38:04 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[68268408-3818-4cd9-acd4-479f0ad1c5bf]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG os_brick.utils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating existing volume attachment record: 1921f867-b278-4f54-9292-0043ec1cc90e {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:38:05 user nova-compute[74880]: INFO nova.compute.claims [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Claim successful on node user
Nov 15 01:38:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:38:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.policy [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dd436c8ece5405789f44db4c8349c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9537a43f73f472c9d8c90ed75d72e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Successfully created port: b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:38:05 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Creating image(s)
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "/opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.203s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk 1073741824" returned: 0 in 0.047s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Cannot resize image /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Ensure instance console log exists: /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Successfully created port: 0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Successfully updated port: b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-changed-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.compute.manager [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Refreshing instance network info cache due to event network-changed-b3698136-315e-4a19-b76a-461c5156facf. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] Acquiring lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] Acquired lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Refreshing network info cache for port b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG nova.network.neutron [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:38:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-7d8a77f1-2169-45f6-af11-423588c9e1ac req-ce0982a4-c00b-4e33-b0ba-e680d03f8b9c service nova] Releasing lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquired lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating instance_info_cache with network_info: [{"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Releasing lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Instance network_info: |[{"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Successfully updated port: 0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquired lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:38:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updating instance_info_cache with network_info: [{"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Releasing lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Instance network_info: |[{"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Start _get_guest_xml network_info=[{"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:38:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:38:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1557366965',display_name='tempest-AttachVolumeNegativeTest-server-1557366965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1557366965',id=47,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGbyUy54CCc9J5mD0jb7s8qThuX0L/tJ+TbvVcBkgaKrcsN+5ao1Ito7YKgZxVJdOJfIXeKdS5VeHCASJ7Hn5AM8T7ZYv8f8DbC1xydHkJa6m0jn0wQ245KPEbQYAwl5g==',key_name='tempest-keypair-459860790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-lkkiqr4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=ec116f6d-6da0-462b-9c52-55421420c7a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'pci_devices' on Instance uuid ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:38:08 user nova-compute[74880]:   <uuid>ec116f6d-6da0-462b-9c52-55421420c7a0</uuid>
Nov 15 01:38:08 user nova-compute[74880]:   <name>instance-0000002f</name>
Nov 15 01:38:08 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:38:08 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:38:08 user nova-compute[74880]:   <metadata>
Nov 15 01:38:08 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:38:08 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:38:08 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1557366965</nova:name>
Nov 15 01:38:08 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:38:08</nova:creationTime>
Nov 15 01:38:08 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:38:08 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:38:08 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:38:08 user nova-compute[74880]:       <nova:owner>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:user uuid="1dd436c8ece5405789f44db4c8349c97">tempest-AttachVolumeNegativeTest-1148149593-project-member</nova:user>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:project uuid="c9537a43f73f472c9d8c90ed75d72e2d">tempest-AttachVolumeNegativeTest-1148149593</nova:project>
Nov 15 01:38:08 user nova-compute[74880]:       </nova:owner>
Nov 15 01:38:08 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:38:08 user nova-compute[74880]:       <nova:ports>
Nov 15 01:38:08 user nova-compute[74880]:         <nova:port uuid="0f0f938a-bfbc-4793-9303-f156e46918f1">
Nov 15 01:38:08 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 01:38:08 user nova-compute[74880]:         </nova:port>
Nov 15 01:38:08 user nova-compute[74880]:       </nova:ports>
Nov 15 01:38:08 user nova-compute[74880]:     </nova:instance>
Nov 15 01:38:08 user nova-compute[74880]:   </metadata>
Nov 15 01:38:08 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:38:08 user nova-compute[74880]:     <system>
Nov 15 01:38:08 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:38:08 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:38:08 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:38:08 user nova-compute[74880]:       <entry name="serial">ec116f6d-6da0-462b-9c52-55421420c7a0</entry>
Nov 15 01:38:08 user nova-compute[74880]:       <entry name="uuid">ec116f6d-6da0-462b-9c52-55421420c7a0</entry>
Nov 15 01:38:08 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:38:08 user nova-compute[74880]:     </system>
Nov 15 01:38:08 user nova-compute[74880]:   </sysinfo>
Nov 15 01:38:08 user nova-compute[74880]:   <os>
Nov 15 01:38:08 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:38:08 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:38:08 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:38:08 user nova-compute[74880]:   </os>
Nov 15 01:38:08 user nova-compute[74880]:   <features>
Nov 15 01:38:08 user nova-compute[74880]:     <acpi/>
Nov 15 01:38:08 user nova-compute[74880]:     <apic/>
Nov 15 01:38:08 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:38:08 user nova-compute[74880]:   </features>
Nov 15 01:38:08 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:38:08 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:38:08 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:38:08 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:38:08 user nova-compute[74880]:   </clock>
Nov 15 01:38:08 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:38:08 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:38:08 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:38:08 user nova-compute[74880]:   </cpu>
Nov 15 01:38:08 user nova-compute[74880]:   <devices>
Nov 15 01:38:08 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:38:08 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:38:08 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk"/>
Nov 15 01:38:08 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:38:08 user nova-compute[74880]:     </disk>
Nov 15 01:38:08 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:38:08 user nova-compute[74880]:       <mac address="fa:16:3e:8a:1d:a0"/>
Nov 15 01:38:08 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:38:08 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:38:08 user nova-compute[74880]:       <target dev="tap0f0f938a-bf"/>
Nov 15 01:38:08 user nova-compute[74880]:     </interface>
Nov 15 01:38:08 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:38:08 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/console.log" append="off"/>
Nov 15 01:38:08 user nova-compute[74880]:     </serial>
Nov 15 01:38:08 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:38:08 user nova-compute[74880]:     <video>
Nov 15 01:38:08 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:38:08 user nova-compute[74880]:     </video>
Nov 15 01:38:08 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:38:08 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:38:08 user nova-compute[74880]:     </rng>
Nov 15 01:38:08 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:38:08 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:38:08 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:38:08 user nova-compute[74880]:     </memballoon>
Nov 15 01:38:08 user nova-compute[74880]:   </devices>
Nov 15 01:38:08 user nova-compute[74880]: </domain>
Nov 15 01:38:08 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1557366965',display_name='tempest-AttachVolumeNegativeTest-server-1557366965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1557366965',id=47,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGbyUy54CCc9J5mD0jb7s8qThuX0L/tJ+TbvVcBkgaKrcsN+5ao1Ito7YKgZxVJdOJfIXeKdS5VeHCASJ7Hn5AM8T7ZYv8f8DbC1xydHkJa6m0jn0wQ245KPEbQYAwl5g==',key_name='tempest-keypair-459860790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-lkkiqr4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=ec116f6d-6da0-462b-9c52-55421420c7a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG os_vif [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f7ef441-85a3-5b70-8f85-38e13eb5cb43', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f0f938a-bf, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f0f938a-bf, col_values=(('qos', UUID('fbe73426-38ab-4dc3-b922-667ef2d5798a')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f0f938a-bf, col_values=(('external_ids', {'iface-id': '0f0f938a-bfbc-4793-9303-f156e46918f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:1d:a0', 'vm-uuid': 'ec116f6d-6da0-462b-9c52-55421420c7a0'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:08 user nova-compute[74880]: INFO os_vif [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf')
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:8a:1d:a0, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-changed-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Refreshing instance network info cache due to event network-changed-0f0f938a-bfbc-4793-9303-f156e46918f1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] Acquiring lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] Acquired lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:38:08 user nova-compute[74880]: DEBUG nova.network.neutron [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Refreshing network info cache for port 0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updated VIF entry in instance network info cache for port 0f0f938a-bfbc-4793-9303-f156e46918f1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updating instance_info_cache with network_info: [{"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-607ccd21-c35b-4442-bbe1-d956899553db req-b6d9ce42-ab32-4b07-954b-8a13b97e95b9 service nova] Releasing lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:38:09 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Creating image(s)
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Ensure instance console log exists: /opt/stack/data/nova/instances/cdd9a3ed-60f6-4802-bea1-ec631dc91818/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Start _get_guest_xml network_info=[{"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cdd9a3ed-60f6-4802-bea1-ec631dc91818', 'attached_at': '', 'detached_at': '', 'volume_id': '03779a9c-ae26-4476-9234-ec2884c41b93', 'serial': '03779a9c-ae26-4476-9234-ec2884c41b93'}, 'mount_device': '/dev/vda', 'attachment_id': '1921f867-b278-4f54-9292-0043ec1cc90e', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:38:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:38:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:38:09 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:38:09 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:38:09 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d7ffaa-27fd-4687-86c0-a47c859b05a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:38:09 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78390a17-2a6f-447f-be51-8ad3d8d2cea9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93] added
Nov 15 01:38:09 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ce10f0-988e-442a-821b-417024526d92]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60cb3f5-f20d-46db-bd12-bfdf1f15b0fe]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WofTJepM {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WofTJepM" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc41a6-c883-4fec-8734-0d038b94bf61]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WofTJepM'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b593ad-ef39-4df1-a936-ba28f2bbc89b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3487ad60-5592-437a-9986-2022f8a48577]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e46a6-f03b-44fa-8c7b-615489b6702f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]
Nov 15 01:38:10 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.
Nov 15 01:38:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e15e6f-03a6-4803-8faf-80fb2129cc1e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[725448ad-c8f2-404a-824a-aa2d08305821]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:38:10 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d4c731-e60b-4e54-818a-33b52813fac8]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] No waiting events found dispatching network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:10 user nova-compute[74880]: WARNING nova.compute.manager [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received unexpected event network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 for instance with vm_state building and task_state spawning.
Nov 15 01:38:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] No waiting events found dispatching network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:10 user nova-compute[74880]: WARNING nova.compute.manager [req-6508bd6a-7e3d-4e6a-86e7-c71cb58fbdd6 req-493a279f-d813-4d26-92c1-41d40be6daf9 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received unexpected event network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 for instance with vm_state building and task_state spawning.
Nov 15 01:38:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23635616262366237', 'path': '/dev/sde'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635616262366237', 'path': '/dev/sde'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1865752276',display_name='tempest-TestVolumeBootPattern-server-1865752276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1865752276',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-l4b2tq54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:38:04Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=cdd9a3ed-60f6-4802-bea1-ec631dc91818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'pci_devices' on Instance uuid cdd9a3ed-60f6-4802-bea1-ec631dc91818 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:38:11 user nova-compute[74880]:   <uuid>cdd9a3ed-60f6-4802-bea1-ec631dc91818</uuid>
Nov 15 01:38:11 user nova-compute[74880]:   <name>instance-0000002e</name>
Nov 15 01:38:11 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:38:11 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:38:11 user nova-compute[74880]:   <metadata>
Nov 15 01:38:11 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:38:11 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:38:11 user nova-compute[74880]:       <nova:name>tempest-TestVolumeBootPattern-server-1865752276</nova:name>
Nov 15 01:38:11 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:38:09</nova:creationTime>
Nov 15 01:38:11 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:38:11 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:38:11 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:38:11 user nova-compute[74880]:       <nova:owner>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:user uuid="484f6e472b2c4cb588dfab3cc9d3932a">tempest-TestVolumeBootPattern-1434286508-project-member</nova:user>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:project uuid="861c2385409b4f5080bf3d81430ddbf0">tempest-TestVolumeBootPattern-1434286508</nova:project>
Nov 15 01:38:11 user nova-compute[74880]:       </nova:owner>
Nov 15 01:38:11 user nova-compute[74880]:       <nova:ports>
Nov 15 01:38:11 user nova-compute[74880]:         <nova:port uuid="b3698136-315e-4a19-b76a-461c5156facf">
Nov 15 01:38:11 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 01:38:11 user nova-compute[74880]:         </nova:port>
Nov 15 01:38:11 user nova-compute[74880]:       </nova:ports>
Nov 15 01:38:11 user nova-compute[74880]:     </nova:instance>
Nov 15 01:38:11 user nova-compute[74880]:   </metadata>
Nov 15 01:38:11 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:38:11 user nova-compute[74880]:     <system>
Nov 15 01:38:11 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:38:11 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:38:11 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:38:11 user nova-compute[74880]:       <entry name="serial">cdd9a3ed-60f6-4802-bea1-ec631dc91818</entry>
Nov 15 01:38:11 user nova-compute[74880]:       <entry name="uuid">cdd9a3ed-60f6-4802-bea1-ec631dc91818</entry>
Nov 15 01:38:11 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:38:11 user nova-compute[74880]:     </system>
Nov 15 01:38:11 user nova-compute[74880]:   </sysinfo>
Nov 15 01:38:11 user nova-compute[74880]:   <os>
Nov 15 01:38:11 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:38:11 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:38:11 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:38:11 user nova-compute[74880]:   </os>
Nov 15 01:38:11 user nova-compute[74880]:   <features>
Nov 15 01:38:11 user nova-compute[74880]:     <acpi/>
Nov 15 01:38:11 user nova-compute[74880]:     <apic/>
Nov 15 01:38:11 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:38:11 user nova-compute[74880]:   </features>
Nov 15 01:38:11 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:38:11 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:38:11 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:38:11 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:38:11 user nova-compute[74880]:   </clock>
Nov 15 01:38:11 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:38:11 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:38:11 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:38:11 user nova-compute[74880]:   </cpu>
Nov 15 01:38:11 user nova-compute[74880]:   <devices>
Nov 15 01:38:11 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:38:11 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:38:11 user nova-compute[74880]:       <source dev="/dev/sde"/>
Nov 15 01:38:11 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:38:11 user nova-compute[74880]:       <serial>03779a9c-ae26-4476-9234-ec2884c41b93</serial>
Nov 15 01:38:11 user nova-compute[74880]:     </disk>
Nov 15 01:38:11 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:38:11 user nova-compute[74880]:       <mac address="fa:16:3e:6e:1d:42"/>
Nov 15 01:38:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:38:11 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:38:11 user nova-compute[74880]:       <target dev="tapb3698136-31"/>
Nov 15 01:38:11 user nova-compute[74880]:     </interface>
Nov 15 01:38:11 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:38:11 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/cdd9a3ed-60f6-4802-bea1-ec631dc91818/console.log" append="off"/>
Nov 15 01:38:11 user nova-compute[74880]:     </serial>
Nov 15 01:38:11 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:38:11 user nova-compute[74880]:     <video>
Nov 15 01:38:11 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:38:11 user nova-compute[74880]:     </video>
Nov 15 01:38:11 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:38:11 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:38:11 user nova-compute[74880]:     </rng>
Nov 15 01:38:11 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:38:11 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:38:11 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:38:11 user nova-compute[74880]:     </memballoon>
Nov 15 01:38:11 user nova-compute[74880]:   </devices>
Nov 15 01:38:11 user nova-compute[74880]: </domain>
Nov 15 01:38:11 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1865752276',display_name='tempest-TestVolumeBootPattern-server-1865752276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1865752276',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-l4b2tq54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:38:04Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=cdd9a3ed-60f6-4802-bea1-ec631dc91818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG os_vif [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd61348c-e645-57bf-9d40-cb55d72519e0', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3698136-31, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3698136-31, col_values=(('qos', UUID('d0b07de5-d340-4e5a-b941-c0b62ee5813d')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3698136-31, col_values=(('external_ids', {'iface-id': 'b3698136-315e-4a19-b76a-461c5156facf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1d:42', 'vm-uuid': 'cdd9a3ed-60f6-4802-bea1-ec631dc91818'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:11 user nova-compute[74880]: INFO os_vif [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31')
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No VIF found with MAC fa:16:3e:6e:1d:42, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:38:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Instance spawned successfully.
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:11 user nova-compute[74880]: INFO nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 15 01:38:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:38:12 user nova-compute[74880]: INFO nova.compute.manager [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Took 7.03 seconds to build instance.
Nov 15 01:38:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e40d864a-e588-4c5f-ada4-96162f7e7f8d tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.144s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-0133c0cb-883e-4e9a-9566-ddf2650d9896 req-14b5e2bf-b327-43af-be27-d2fc7cff6c93 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0133c0cb-883e-4e9a-9566-ddf2650d9896 req-14b5e2bf-b327-43af-be27-d2fc7cff6c93 service nova] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0133c0cb-883e-4e9a-9566-ddf2650d9896 req-14b5e2bf-b327-43af-be27-d2fc7cff6c93 service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0133c0cb-883e-4e9a-9566-ddf2650d9896 req-14b5e2bf-b327-43af-be27-d2fc7cff6c93 service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-0133c0cb-883e-4e9a-9566-ddf2650d9896 req-14b5e2bf-b327-43af-be27-d2fc7cff6c93 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] No waiting events found dispatching network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:12 user nova-compute[74880]: WARNING nova.compute.manager [req-0133c0cb-883e-4e9a-9566-ddf2650d9896 req-14b5e2bf-b327-43af-be27-d2fc7cff6c93 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received unexpected event network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf for instance with vm_state building and task_state spawning.
Nov 15 01:38:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-b89b297e-3158-4630-b28a-e38ecf34c484 req-da74729e-01fd-4ac5-bb09-c419772d526b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b89b297e-3158-4630-b28a-e38ecf34c484 req-da74729e-01fd-4ac5-bb09-c419772d526b service nova] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b89b297e-3158-4630-b28a-e38ecf34c484 req-da74729e-01fd-4ac5-bb09-c419772d526b service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b89b297e-3158-4630-b28a-e38ecf34c484 req-da74729e-01fd-4ac5-bb09-c419772d526b service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:14 user nova-compute[74880]: DEBUG nova.compute.manager [req-b89b297e-3158-4630-b28a-e38ecf34c484 req-da74729e-01fd-4ac5-bb09-c419772d526b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] No waiting events found dispatching network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:14 user nova-compute[74880]: WARNING nova.compute.manager [req-b89b297e-3158-4630-b28a-e38ecf34c484 req-da74729e-01fd-4ac5-bb09-c419772d526b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received unexpected event network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf for instance with vm_state building and task_state spawning.
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:38:15 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Instance spawned successfully.
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:38:15 user nova-compute[74880]: INFO nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 15 01:38:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:38:15 user nova-compute[74880]: INFO nova.compute.manager [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Took 11.40 seconds to build instance.
Nov 15 01:38:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fee9a898-d11c-4ad7-98e5-a0c4141672fc tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.499s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:20 user nova-compute[74880]: INFO nova.compute.manager [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Unrescuing
Nov 15 01:38:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquired lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Releasing lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'flavor' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-6f7d4f42-4ad0-4f6a-9292-a396966a3605 req-b08ab853-6b82-4e98-9965-af8770fd24a9 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6f7d4f42-4ad0-4f6a-9292-a396966a3605 req-b08ab853-6b82-4e98-9965-af8770fd24a9 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6f7d4f42-4ad0-4f6a-9292-a396966a3605 req-b08ab853-6b82-4e98-9965-af8770fd24a9 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6f7d4f42-4ad0-4f6a-9292-a396966a3605 req-b08ab853-6b82-4e98-9965-af8770fd24a9 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-6f7d4f42-4ad0-4f6a-9292-a396966a3605 req-b08ab853-6b82-4e98-9965-af8770fd24a9 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:20 user nova-compute[74880]: WARNING nova.compute.manager [req-6f7d4f42-4ad0-4f6a-9292-a396966a3605 req-b08ab853-6b82-4e98-9965-af8770fd24a9 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:38:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance destroyed successfully.
Nov 15 01:38:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:23 user nova-compute[74880]: WARNING nova.compute.manager [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:38:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:23 user nova-compute[74880]: WARNING nova.compute.manager [req-410b6bbe-ea29-4e6b-ba71-b3ccc95d1c0a req-81bdf216-3a2c-4d14-b54d-8bd0489e122c service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:38:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:25 user nova-compute[74880]: DEBUG nova.compute.manager [None req-8964ede8-32c0-4fff-babf-bf050d8c2f80 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:38:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-676898ba-5fcf-4c61-84cc-2576bb2ccfbf req-d50c8e3a-b6b7-47ef-89f9-d70e9a4bb38a service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:38:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-676898ba-5fcf-4c61-84cc-2576bb2ccfbf req-d50c8e3a-b6b7-47ef-89f9-d70e9a4bb38a service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-676898ba-5fcf-4c61-84cc-2576bb2ccfbf req-d50c8e3a-b6b7-47ef-89f9-d70e9a4bb38a service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-676898ba-5fcf-4c61-84cc-2576bb2ccfbf req-d50c8e3a-b6b7-47ef-89f9-d70e9a4bb38a service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-676898ba-5fcf-4c61-84cc-2576bb2ccfbf req-d50c8e3a-b6b7-47ef-89f9-d70e9a4bb38a service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:38:25 user nova-compute[74880]: WARNING nova.compute.manager [req-676898ba-5fcf-4c61-84cc-2576bb2ccfbf req-d50c8e3a-b6b7-47ef-89f9-d70e9a4bb38a service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 01:38:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:54 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:38:57 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:58 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:38:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:38:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:38:58 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [{"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-f126fb29-d56c-4f6b-9b79-a4944e5ce618" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:38:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:39:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:39:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=25.085147857666016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8361002e-bba9-454c-addc-e740d02b6a4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance cdd9a3ed-60f6-4802-bea1-ec631dc91818 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ec116f6d-6da0-462b-9c52-55421420c7a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:39:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:39:02 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:39:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:39:02 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:39:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:39:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:39:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:39:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:39:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:39:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:39:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:39:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:39:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:39:21 user nova-compute[74880]: INFO nova.compute.manager [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Detaching volume 47ecc078-07a0-4c75-9877-835f1419bc40
Nov 15 01:39:21 user nova-compute[74880]: INFO nova.virt.block_device [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Attempting to driver detach volume 47ecc078-07a0-4c75-9877-835f1419bc40 from mountpoint /dev/vdc
Nov 15 01:39:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Attempting to detach device vdc from instance 8361002e-bba9-454c-addc-e740d02b6a4d from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:39:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:39:21 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:39:21 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:39:21 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:39:21 user nova-compute[74880]:   <serial>47ecc078-07a0-4c75-9877-835f1419bc40</serial>
Nov 15 01:39:21 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:39:21 user nova-compute[74880]: </disk>
Nov 15 01:39:21 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:39:21 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully detached device vdc from instance 8361002e-bba9-454c-addc-e740d02b6a4d from the persistent domain config.
Nov 15 01:39:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8361002e-bba9-454c-addc-e740d02b6a4d from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:39:21 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:39:21 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:39:21 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:39:21 user nova-compute[74880]:   <target dev="vdc" bus="virtio"/>
Nov 15 01:39:21 user nova-compute[74880]:   <serial>47ecc078-07a0-4c75-9877-835f1419bc40</serial>
Nov 15 01:39:21 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:39:21 user nova-compute[74880]: </disk>
Nov 15 01:39:21 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:39:22 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:39:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:42 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8361002e-bba9-454c-addc-e740d02b6a4d is timed out.
Nov 15 01:39:42 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully detached device vdc from instance 8361002e-bba9-454c-addc-e740d02b6a4d from the live domain config.
Nov 15 01:39:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxHZntAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:39:42 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddc5fc0-0011-4cf5-bc73-1650598784fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:39:42 user nova-compute[74880]: No targets found.
Nov 15 01:39:42 user nova-compute[74880]: iSNS:
Nov 15 01:39:42 user nova-compute[74880]: No targets found.
Nov 15 01:39:42 user nova-compute[74880]: STATIC:
Nov 15 01:39:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:39:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:39:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:39:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40
Nov 15 01:39:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:39:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:39:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:39:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:39:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:39:42 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:39:42 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:39:42 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:39:42 user nova-compute[74880]: FIRMWARE:
Nov 15 01:39:42 user nova-compute[74880]: No targets found.
Nov 15 01:39:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:39:42 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:39:42 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c3b00c-ecef-4c47-a9e1-16cd0b2501b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[219f2aa2-1276-4e3f-baae-ba5eb96d9ce0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:39:42 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:39:42 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:39:42 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:39:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:39:42 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:39:42 user nova-compute[74880]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 (non-flash)
Nov 15 01:39:42 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:39:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f013f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ae214e-5cf6-43af-a538-ec569827560b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733f3c6-f906-46b2-955a-9157b6d249c4]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[554c197d-a919-4535-9e72-2eb59829b485]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f704a005-0feb-4467-9f26-8007b2d072da]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504cd40-385e-4ea2-a1d2-df1ac9add271]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b499c4ea-54e2-4a53-9e2c-7217e2f5a102]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260]
Nov 15 01:39:42 user nova-compute[74880]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40, portal: 172.16.0.220,3260] successful.
Nov 15 01:39:42 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47ecc078-07a0-4c75-9877-835f1419bc40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[838dc564-19cc-4ae1-9a50-5457183b7852]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] <== disconnect_volume: return (327ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:39:42 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:39:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'flavor' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:39:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-5b5bb371-8359-46cb-9785-1919300e9284 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:39:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:39:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:39:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:39:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:39:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:39:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-changed-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:39:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Refreshing instance network info cache due to event network-changed-b3698136-315e-4a19-b76a-461c5156facf. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:39:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] Acquiring lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:39:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] Acquired lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:39:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Refreshing network info cache for port b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-changed-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Refreshing instance network info cache due to event network-changed-0f0f938a-bfbc-4793-9303-f156e46918f1. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] Acquiring lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] Acquired lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Refreshing network info cache for port 0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updated VIF entry in instance network info cache for port b3698136-315e-4a19-b76a-461c5156facf. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating instance_info_cache with network_info: [{"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc65d448-0ceb-4940-b3a7-115ac9e0260b req-6205daae-979d-43e3-b276-4cfc19b05f6b service nova] Releasing lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updated VIF entry in instance network info cache for port 0f0f938a-bfbc-4793-9303-f156e46918f1. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updating instance_info_cache with network_info: [{"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8bf10c3b-d1b9-46fa-9671-6d978ca4fd22 req-c28c481e-9dd3-4add-a809-78ab8ad7f6c7 service nova] Releasing lock "refresh_cache-ec116f6d-6da0-462b-9c52-55421420c7a0" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:39:56 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:39:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:39:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:39:58 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:39:59 user nova-compute[74880]: INFO nova.compute.manager [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Attaching volume 07429340-7218-40ee-b5b8-d8896d3c6f4d to /dev/vdb
Nov 15 01:39:59 user nova-compute[74880]: DEBUG os_brick.utils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f650de4-b647-4b1a-a3d6-b4bd7df7204f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfdbbaf-2fce-4f35-ada8-f74bbbdc58be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0b92e-3cac-4cf8-b170-3bf1519bfd4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c8615-1bcb-4842-bc95-2ecee6ced1f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:39:59 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f18afb-3d55-41ef-8015-54df94790fcb]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG os_brick.utils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updating existing volume attachment record: 4ff18d48-91ce-4363-ae17-8dc6bef3a73d {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:39:59 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:40:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:40:02 user nova-compute[74880]: INFO nova.compute.claims [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Claim successful on node user
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:02 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:40:02 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=25.083961486816406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:40:02 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.896s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.163s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:40:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8361002e-bba9-454c-addc-e740d02b6a4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance cdd9a3ed-60f6-4802-bea1-ec631dc91818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance ec116f6d-6da0-462b-9c52-55421420c7a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance afd8f7ab-8f22-4e4d-b474-66655783eb82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.policy [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '484f6e472b2c4cb588dfab3cc9d3932a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c2385409b4f5080bf3d81430ddbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:40:03 user nova-compute[74880]: INFO nova.virt.block_device [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Booting with volume 2f02c9ea-2f8f-435f-88c5-67f11e4053ae at /dev/vda
Nov 15 01:40:03 user nova-compute[74880]: DEBUG os_brick.utils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226ed09-b270-4d14-aeaa-5be1a730934b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c782f2fa-8928-49c0-843a-22f82c3a1337]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[194278ea-8366-4a7e-b39e-5b59e2601000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fef10b-16d6-4d19-87c3-f443add36f98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:40:03 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d18f1d-3bef-456e-8aac-8660bbaccb1e]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG os_brick.utils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updating existing volume attachment record: 42b31fb2-1245-47c2-a85b-812c693c6ca7 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Successfully created port: 834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLpXiHgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:40:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:40:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:40:04 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a953cb-911c-4709-a4cc-bcaa463390c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:40:04 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[62939e3e-242e-4ec2-b574-952d0bf35a22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d] added
Nov 15 01:40:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa6c1b-c758-42da-817f-672a16383042]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Successfully updated port: 834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d0326d-698c-4909-8776-42989eb2d306]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLpXiHgA {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquired lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLpXiHgA" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ee9f6-c9c9-42a8-9183-101d60e69315]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLpXiHgA'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-changed-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Refreshing instance network info cache due to event network-changed-834970dd-2de9-4700-a41f-823cc66fd686. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] Acquiring lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9400f6db-3dc4-4f14-94bd-c7c43b3ed1aa]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1753724-02e7-4f43-8641-1aa1bc37c152]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b9d96-d4c8-45fa-ac8a-a98e614461e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260]
Nov 15 01:40:04 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260] successful.
Nov 15 01:40:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[518c8e9e-4035-4eb6-8678-5ee7925d8f4b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e5114-8a24-4fa0-978f-7563c56e2c07]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:04 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465b480-bb91-454e-a875-743e859def66]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLpXiHgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updating instance_info_cache with network_info: [{"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Releasing lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Instance network_info: |[{"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] Acquired lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:40:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Refreshing network info cache for port 834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updated VIF entry in instance network info cache for port 834970dd-2de9-4700-a41f-823cc66fd686. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updating instance_info_cache with network_info: [{"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8981aa57-1735-4ea2-a5d6-e4841ee67d4d req-b1030c16-feb5-4b18-9986-f820e951b86a service nova] Releasing lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23266326431633463', 'path': '/dev/sdd'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266326431633463', 'path': '/dev/sdd'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG nova.objects.instance [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:40:05 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:40:05 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:40:05 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:40:05 user nova-compute[74880]:   <serial>07429340-7218-40ee-b5b8-d8896d3c6f4d</serial>
Nov 15 01:40:05 user nova-compute[74880]: </disk>
Nov 15 01:40:05 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:40:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:40:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:40:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] No VIF found with MAC fa:16:3e:8a:1d:a0, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:40:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-8013bc28-38af-43f3-b5fd-c2fd4142a4e1 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.968s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:07 user nova-compute[74880]: INFO nova.compute.manager [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Detaching volume 07429340-7218-40ee-b5b8-d8896d3c6f4d
Nov 15 01:40:07 user nova-compute[74880]: INFO nova.virt.block_device [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Attempting to driver detach volume 07429340-7218-40ee-b5b8-d8896d3c6f4d from mountpoint /dev/vdb
Nov 15 01:40:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Attempting to detach device vdb from instance ec116f6d-6da0-462b-9c52-55421420c7a0 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:40:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:40:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:40:07 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:40:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:40:07 user nova-compute[74880]:   <serial>07429340-7218-40ee-b5b8-d8896d3c6f4d</serial>
Nov 15 01:40:07 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:40:07 user nova-compute[74880]: </disk>
Nov 15 01:40:07 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:40:07 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully detached device vdb from instance ec116f6d-6da0-462b-9c52-55421420c7a0 from the persistent domain config.
Nov 15 01:40:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec116f6d-6da0-462b-9c52-55421420c7a0 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:40:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:40:07 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:40:07 user nova-compute[74880]:   <source dev="/dev/sdd"/>
Nov 15 01:40:07 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:40:07 user nova-compute[74880]:   <serial>07429340-7218-40ee-b5b8-d8896d3c6f4d</serial>
Nov 15 01:40:07 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:40:07 user nova-compute[74880]: </disk>
Nov 15 01:40:07 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:40:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:40:08 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Creating image(s)
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Did not create local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Ensure instance console log exists: /opt/stack/data/nova/instances/afd8f7ab-8f22-4e4d-b474-66655783eb82/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Start _get_guest_xml network_info=[{"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePEGduMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'afd8f7ab-8f22-4e4d-b474-66655783eb82', 'attached_at': '', 'detached_at': '', 'volume_id': '2f02c9ea-2f8f-435f-88c5-67f11e4053ae', 'serial': '2f02c9ea-2f8f-435f-88c5-67f11e4053ae'}, 'mount_device': '/dev/vda', 'attachment_id': '42b31fb2-1245-47c2-a85b-812c693c6ca7', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:40:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:40:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePEGduMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:40:08 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:40:08 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:40:08 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[240ddd40-16f5-4e4c-b898-098759282e84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:40:08 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f340a0ab-dffa-4868-a8d3-302f37971474]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae] added
Nov 15 01:40:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd7d7f-ffc0-494f-a129-4e29b90a309c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af289c9c-3cdc-43b9-a37b-bc26e8cc9551]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePEGduMR {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePEGduMR" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a8fe1-e7c1-41d2-abe6-c03a61a9c0e3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePEGduMR'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcf63c9-b864-47d5-bb9a-969d277d8bad]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6408e8f0-a57f-434b-89c4-d8394ed15edd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba9cf1-4063-4a6d-9914-488598824131]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260]
Nov 15 01:40:08 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260] successful.
Nov 15 01:40:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c666f0d-bb4e-488e-9e3d-7fc9dd55ae24]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f203afa-9fe9-4a56-8e6b-544f09f55ed0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:40:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:08 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:40:08 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] HCTL ('37', '-', '-', 0) found on session 59 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[48691d17-662d-4a04-91fd-d17cc0b88715]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 59 and hctl ['37', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:40:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Searching for a device in session 59 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePEGduMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26564373336356235', 'path': '/dev/sdf'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564373336356235', 'path': '/dev/sdf'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-312243951',display_name='tempest-TestVolumeBootPattern-server-312243951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-312243951',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-on4l3m6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:40:03Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=afd8f7ab-8f22-4e4d-b474-66655783eb82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'pci_devices' on Instance uuid afd8f7ab-8f22-4e4d-b474-66655783eb82 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:40:09 user nova-compute[74880]:   <uuid>afd8f7ab-8f22-4e4d-b474-66655783eb82</uuid>
Nov 15 01:40:09 user nova-compute[74880]:   <name>instance-00000030</name>
Nov 15 01:40:09 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:40:09 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:40:09 user nova-compute[74880]:   <metadata>
Nov 15 01:40:09 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:40:09 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:40:09 user nova-compute[74880]:       <nova:name>tempest-TestVolumeBootPattern-server-312243951</nova:name>
Nov 15 01:40:09 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:40:08</nova:creationTime>
Nov 15 01:40:09 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:40:09 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:40:09 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:40:09 user nova-compute[74880]:       <nova:owner>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:user uuid="484f6e472b2c4cb588dfab3cc9d3932a">tempest-TestVolumeBootPattern-1434286508-project-member</nova:user>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:project uuid="861c2385409b4f5080bf3d81430ddbf0">tempest-TestVolumeBootPattern-1434286508</nova:project>
Nov 15 01:40:09 user nova-compute[74880]:       </nova:owner>
Nov 15 01:40:09 user nova-compute[74880]:       <nova:ports>
Nov 15 01:40:09 user nova-compute[74880]:         <nova:port uuid="834970dd-2de9-4700-a41f-823cc66fd686">
Nov 15 01:40:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 01:40:09 user nova-compute[74880]:         </nova:port>
Nov 15 01:40:09 user nova-compute[74880]:       </nova:ports>
Nov 15 01:40:09 user nova-compute[74880]:     </nova:instance>
Nov 15 01:40:09 user nova-compute[74880]:   </metadata>
Nov 15 01:40:09 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:40:09 user nova-compute[74880]:     <system>
Nov 15 01:40:09 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:40:09 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:40:09 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:40:09 user nova-compute[74880]:       <entry name="serial">afd8f7ab-8f22-4e4d-b474-66655783eb82</entry>
Nov 15 01:40:09 user nova-compute[74880]:       <entry name="uuid">afd8f7ab-8f22-4e4d-b474-66655783eb82</entry>
Nov 15 01:40:09 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:40:09 user nova-compute[74880]:     </system>
Nov 15 01:40:09 user nova-compute[74880]:   </sysinfo>
Nov 15 01:40:09 user nova-compute[74880]:   <os>
Nov 15 01:40:09 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:40:09 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:40:09 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:40:09 user nova-compute[74880]:   </os>
Nov 15 01:40:09 user nova-compute[74880]:   <features>
Nov 15 01:40:09 user nova-compute[74880]:     <acpi/>
Nov 15 01:40:09 user nova-compute[74880]:     <apic/>
Nov 15 01:40:09 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:40:09 user nova-compute[74880]:   </features>
Nov 15 01:40:09 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:40:09 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:40:09 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:40:09 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:40:09 user nova-compute[74880]:   </clock>
Nov 15 01:40:09 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:40:09 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:40:09 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:40:09 user nova-compute[74880]:   </cpu>
Nov 15 01:40:09 user nova-compute[74880]:   <devices>
Nov 15 01:40:09 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:40:09 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:40:09 user nova-compute[74880]:       <source dev="/dev/sdf"/>
Nov 15 01:40:09 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:40:09 user nova-compute[74880]:       <serial>2f02c9ea-2f8f-435f-88c5-67f11e4053ae</serial>
Nov 15 01:40:09 user nova-compute[74880]:     </disk>
Nov 15 01:40:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:40:09 user nova-compute[74880]:       <mac address="fa:16:3e:e5:9f:40"/>
Nov 15 01:40:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:40:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:40:09 user nova-compute[74880]:       <target dev="tap834970dd-2d"/>
Nov 15 01:40:09 user nova-compute[74880]:     </interface>
Nov 15 01:40:09 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:40:09 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/afd8f7ab-8f22-4e4d-b474-66655783eb82/console.log" append="off"/>
Nov 15 01:40:09 user nova-compute[74880]:     </serial>
Nov 15 01:40:09 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:40:09 user nova-compute[74880]:     <video>
Nov 15 01:40:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:40:09 user nova-compute[74880]:     </video>
Nov 15 01:40:09 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:40:09 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:40:09 user nova-compute[74880]:     </rng>
Nov 15 01:40:09 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:40:09 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:40:09 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:40:09 user nova-compute[74880]:     </memballoon>
Nov 15 01:40:09 user nova-compute[74880]:   </devices>
Nov 15 01:40:09 user nova-compute[74880]: </domain>
Nov 15 01:40:09 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-312243951',display_name='tempest-TestVolumeBootPattern-server-312243951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-312243951',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-on4l3m6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:40:03Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=afd8f7ab-8f22-4e4d-b474-66655783eb82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG os_vif [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b03f5054-9b1d-5348-bf6a-9b2d3423660d', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap834970dd-2d, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap834970dd-2d, col_values=(('qos', UUID('c7852e56-1442-4d5c-b671-0102e3672e76')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap834970dd-2d, col_values=(('external_ids', {'iface-id': '834970dd-2de9-4700-a41f-823cc66fd686', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:9f:40', 'vm-uuid': 'afd8f7ab-8f22-4e4d-b474-66655783eb82'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:09 user nova-compute[74880]: INFO os_vif [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d')
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] No VIF found with MAC fa:16:3e:e5:9f:40, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:40:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-9006f9b6-3440-4078-b982-7ad8fa8cf04e req-0cc454b6-8c1f-4a5b-ac53-466a9d36ef2d service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9006f9b6-3440-4078-b982-7ad8fa8cf04e req-0cc454b6-8c1f-4a5b-ac53-466a9d36ef2d service nova] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9006f9b6-3440-4078-b982-7ad8fa8cf04e req-0cc454b6-8c1f-4a5b-ac53-466a9d36ef2d service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9006f9b6-3440-4078-b982-7ad8fa8cf04e req-0cc454b6-8c1f-4a5b-ac53-466a9d36ef2d service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-9006f9b6-3440-4078-b982-7ad8fa8cf04e req-0cc454b6-8c1f-4a5b-ac53-466a9d36ef2d service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] No waiting events found dispatching network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:11 user nova-compute[74880]: WARNING nova.compute.manager [req-9006f9b6-3440-4078-b982-7ad8fa8cf04e req-0cc454b6-8c1f-4a5b-ac53-466a9d36ef2d service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received unexpected event network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 for instance with vm_state building and task_state spawning.
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:11 user nova-compute[74880]: INFO nova.compute.manager [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Terminating instance
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:11 user nova-compute[74880]: INFO nova.compute.manager [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Terminating instance
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:40:11 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Instance destroyed successfully.
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'resources' on Instance uuid f126fb29-d56c-4f6b-9b79-a4944e5ce618 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982436322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982436322',id=44,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:36:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-wkc5pu6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:38:25Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=f126fb29-d56c-4f6b-9b79-a4944e5ce618,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "address": "fa:16:3e:59:f3:ef", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf3540-8e", "ovs_interfaceid": "4eaf3540-8ef3-4f5d-af12-a9afb7b75b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG os_vif [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eaf3540-8e, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0db9478-c342-42a3-b139-aca6cb8b618d) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: INFO os_vif [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:f3:ef,bridge_name='br-int',has_traffic_filtering=True,id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf3540-8e')
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEFwDQfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:40:12 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a20865-23d9-4bda-9724-0337782e46de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:40:12 user nova-compute[74880]: No targets found.
Nov 15 01:40:12 user nova-compute[74880]: iSNS:
Nov 15 01:40:12 user nova-compute[74880]: No targets found.
Nov 15 01:40:12 user nova-compute[74880]: STATIC:
Nov 15 01:40:12 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d
Nov 15 01:40:12 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:12 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:12 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:40:12 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:12 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:12 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:40:12 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:12 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:12 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23
Nov 15 01:40:12 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:12 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:12 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae
Nov 15 01:40:12 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:12 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:12 user nova-compute[74880]: FIRMWARE:
Nov 15 01:40:12 user nova-compute[74880]: No targets found.
Nov 15 01:40:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:40:12 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:40:12 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[442ff926-836a-419e-a640-19a4ae32c614]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9f1e8e-27c0-4170-83b8-966c137464c2]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:40:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:12 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:40:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f0280550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23'): ({'sdc'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Removing single pathed devices sdc {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a90021-9ab4-4705-ba12-57f815d0ca53]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955d270-48c3-465b-955f-63ca9ed55d11]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flushing IO for device /dev/sdc {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e81856-69d5-41cf-a453-e3b2641bf8ed]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.127s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7468ecf-b91c-49f4-9bc1-b03a37e35239]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] SCSI volumes sdc have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f9dc37-7745-4f37-81bc-cd25e3b13367]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ec7c8-2b9b-4f4e-a121-7ccb4b9164d4]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260]
Nov 15 01:40:12 user nova-compute[74880]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23, portal: 172.16.0.220,3260] successful.
Nov 15 01:40:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ec99f-862b-4b1d-b911-b82c051d0c23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10419f-5f88-4be1-b9b4-dcc60c3f8333]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== disconnect_volume: return (438ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Deleting instance files /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618_del
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Deletion of /opt/stack/data/nova/instances/f126fb29-d56c-4f6b-9b79-a4944e5ce618_del complete
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.compute.manager [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Instance destroyed successfully.
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.objects.instance [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'resources' on Instance uuid 8361002e-bba9-454c-addc-e740d02b6a4d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2143680415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2143680415',id=41,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2Oxku1pFVRbeFlj6kmyWm8J23XlwNWkQA8eH5GfqwsKxXuZNWjBdlWgybE0vSLMqLWdcNoXlI/jBenjueqJU5cZbz3f1+Lu0Ow5u7Ny3T1Ihy5gKjL08zp4rSenxESRg==',key_name='tempest-keypair-87033895',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-brnwyvfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=8361002e-bba9-454c-addc-e740d02b6a4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "ccf3a5af-da88-48ce-afde-22d3c746c687", "address": "fa:16:3e:8f:de:ea", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf3a5af-da", "ovs_interfaceid": "ccf3a5af-da88-48ce-afde-22d3c746c687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG os_vif [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf3a5af-da, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e30ec79-50be-4ed7-b44f-4fa6e59b139a) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:12 user nova-compute[74880]: INFO os_vif [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:de:ea,bridge_name='br-int',has_traffic_filtering=True,id=ccf3a5af-da88-48ce-afde-22d3c746c687,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf3a5af-da')
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Deleting instance files /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d_del
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Deletion of /opt/stack/data/nova/instances/8361002e-bba9-454c-addc-e740d02b6a4d_del complete
Nov 15 01:40:12 user nova-compute[74880]: INFO nova.compute.manager [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 01:40:12 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:40:12 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Instance spawned successfully.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] No waiting events found dispatching network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:13 user nova-compute[74880]: WARNING nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received unexpected event network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 for instance with vm_state building and task_state spawning.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-unplugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Acquiring lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] No waiting events found dispatching network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:13 user nova-compute[74880]: WARNING nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received unexpected event network-vif-plugged-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 for instance with vm_state active and task_state deleting.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-unplugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-unplugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-unplugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Acquiring lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] Lock "8361002e-bba9-454c-addc-e740d02b6a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] No waiting events found dispatching network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:13 user nova-compute[74880]: WARNING nova.compute.manager [req-baaf5e89-57c1-4849-9579-9c9306a1a2b9 req-0d588ea8-5a11-48ee-95ce-439522b60182 service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received unexpected event network-vif-plugged-ccf3a5af-da88-48ce-afde-22d3c746c687 for instance with vm_state active and task_state deleting.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Took 0.63 seconds to deallocate network for instance.
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-878047e7-0a06-49af-a07f-a7e00e0f304f req-e681c81f-7016-4b22-b77f-7ad2b2485ae3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Received event network-vif-deleted-4eaf3540-8ef3-4f5d-af12-a9afb7b75b27 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.compute.manager [req-878047e7-0a06-49af-a07f-a7e00e0f304f req-e681c81f-7016-4b22-b77f-7ad2b2485ae3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Neutron deleted interface 4eaf3540-8ef3-4f5d-af12-a9afb7b75b27; detaching it from the instance and deleting it from the info cache
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.network.neutron [req-878047e7-0a06-49af-a07f-a7e00e0f304f req-e681c81f-7016-4b22-b77f-7ad2b2485ae3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-878047e7-0a06-49af-a07f-a7e00e0f304f req-e681c81f-7016-4b22-b77f-7ad2b2485ae3 service nova] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Detach interface failed, port_id=4eaf3540-8ef3-4f5d-af12-a9afb7b75b27, reason: Instance f126fb29-d56c-4f6b-9b79-a4944e5ce618 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.compute.manager [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Took 11.27 seconds to build instance.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9384d7c8-ff95-4394-9959-e0690f26735f tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.364s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Took 0.82 seconds to deallocate network for instance.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.compute.manager [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: f126fb29-d56c-4f6b-9b79-a4944e5ce618] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:13 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Deleted allocations for instance 8361002e-bba9-454c-addc-e740d02b6a4d
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-208a8456-e26f-45d5-ad9a-bf1ecf46d6ad tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "8361002e-bba9-454c-addc-e740d02b6a4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:14 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:40:14 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:40:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:14 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Deleted allocations for instance f126fb29-d56c-4f6b-9b79-a4944e5ce618
Nov 15 01:40:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-eb14e1d4-8257-4f23-85ab-e68a49463330 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "f126fb29-d56c-4f6b-9b79-a4944e5ce618" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:15 user nova-compute[74880]: DEBUG nova.compute.manager [req-101c3e77-0fb3-4f17-bbd2-fa4e195ac508 req-08f12696-6d49-4da9-9774-a0171607c7dc service nova] [instance: 8361002e-bba9-454c-addc-e740d02b6a4d] Received event network-vif-deleted-ccf3a5af-da88-48ce-afde-22d3c746c687 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 9beee7a8-c7eb-45bd-8080-a802365f0029 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid cdd9a3ed-60f6-4802-bea1-ec631dc91818 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid afd8f7ab-8f22-4e4d-b474-66655783eb82 {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec116f6d-6da0-462b-9c52-55421420c7a0 is timed out.
Nov 15 01:40:27 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully detached device vdb from instance ec116f6d-6da0-462b-9c52-55421420c7a0 from the live domain config.
Nov 15 01:40:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLpXiHgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:40:27 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669c554-3aaa-4f16-9d8e-90c41a5765b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:40:27 user nova-compute[74880]: No targets found.
Nov 15 01:40:27 user nova-compute[74880]: iSNS:
Nov 15 01:40:27 user nova-compute[74880]: No targets found.
Nov 15 01:40:27 user nova-compute[74880]: STATIC:
Nov 15 01:40:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d
Nov 15 01:40:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:40:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:40:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:27 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae
Nov 15 01:40:27 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:40:27 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:40:27 user nova-compute[74880]: FIRMWARE:
Nov 15 01:40:27 user nova-compute[74880]: No targets found.
Nov 15 01:40:27 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:40:27 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:40:27 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[624e52a9-bbf5-4e6a-ace4-4fd49b9e9763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[473bdef5-2e93-4411-a961-565298af55b0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:27 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:27 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:27 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:40:27 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:40:27 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:40:27 user nova-compute[74880]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d (non-flash)
Nov 15 01:40:27 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:40:27 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f07a5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d'): ({'sdd'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Removing single pathed devices sdd {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673ea01-4c49-49f5-a978-57514875c8cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0628b-ad3d-4752-8ea6-f87f2c62d6b7]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Flushing IO for device /dev/sdd {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5f4de4-0772-421f-8309-ff9ea778101e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e3dec2-3bf5-4fd4-95cf-c035efbe1f26]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] SCSI volumes sdd have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a69acac-e7eb-4f81-a434-038262e45f3e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b65f2-f033-4b3e-83e8-746acbfed268]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260]
Nov 15 01:40:28 user nova-compute[74880]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d, portal: 172.16.0.220,3260] successful.
Nov 15 01:40:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07429340-7218-40ee-b5b8-d8896d3c6f4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1403cb8b-791c-48a1-a97e-c798635c4d1a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] <== disconnect_volume: return (309ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'flavor' on Instance uuid ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d2dee875-d57d-4765-8a6c-97a3986eff36 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.107s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:40:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:40:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:40:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:57 user nova-compute[74880]: INFO nova.compute.manager [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Terminating instance
Nov 15 01:40:57 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-0b0514c9-c6e7-4449-9e30-15b2eb3c12a5 req-f1f4c88c-5ad6-4e0b-bda3-211688c9b53a service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-vif-unplugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0b0514c9-c6e7-4449-9e30-15b2eb3c12a5 req-f1f4c88c-5ad6-4e0b-bda3-211688c9b53a service nova] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0b0514c9-c6e7-4449-9e30-15b2eb3c12a5 req-f1f4c88c-5ad6-4e0b-bda3-211688c9b53a service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0b0514c9-c6e7-4449-9e30-15b2eb3c12a5 req-f1f4c88c-5ad6-4e0b-bda3-211688c9b53a service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-0b0514c9-c6e7-4449-9e30-15b2eb3c12a5 req-f1f4c88c-5ad6-4e0b-bda3-211688c9b53a service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] No waiting events found dispatching network-vif-unplugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:57 user nova-compute[74880]: DEBUG nova.compute.manager [req-0b0514c9-c6e7-4449-9e30-15b2eb3c12a5 req-f1f4c88c-5ad6-4e0b-bda3-211688c9b53a service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-vif-unplugged-0f0f938a-bfbc-4793-9303-f156e46918f1 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Instance destroyed successfully.
Nov 15 01:40:58 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lazy-loading 'resources' on Instance uuid ec116f6d-6da0-462b-9c52-55421420c7a0 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1557366965',display_name='tempest-AttachVolumeNegativeTest-server-1557366965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1557366965',id=47,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGbyUy54CCc9J5mD0jb7s8qThuX0L/tJ+TbvVcBkgaKrcsN+5ao1Ito7YKgZxVJdOJfIXeKdS5VeHCASJ7Hn5AM8T7ZYv8f8DbC1xydHkJa6m0jn0wQ245KPEbQYAwl5g==',key_name='tempest-keypair-459860790',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:38:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9537a43f73f472c9d8c90ed75d72e2d',ramdisk_id='',reservation_id='r-lkkiqr4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1148149593',owner_user_name='tempest-AttachVolumeNegativeTest-1148149593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dd436c8ece5405789f44db4c8349c97',uuid=ec116f6d-6da0-462b-9c52-55421420c7a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converting VIF {"id": "0f0f938a-bfbc-4793-9303-f156e46918f1", "address": "fa:16:3e:8a:1d:a0", "network": {"id": "10c61e3d-92cb-4352-94cb-33d73a4648a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1971884807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9537a43f73f472c9d8c90ed75d72e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0f938a-bf", "ovs_interfaceid": "0f0f938a-bfbc-4793-9303-f156e46918f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG os_vif [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f0f938a-bf, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbe73426-38ab-4dc3-b922-667ef2d5798a) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:40:58 user nova-compute[74880]: INFO os_vif [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=0f0f938a-bfbc-4793-9303-f156e46918f1,network=Network(10c61e3d-92cb-4352-94cb-33d73a4648a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0f938a-bf')
Nov 15 01:40:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Deleting instance files /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0_del
Nov 15 01:40:58 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Deletion of /opt/stack/data/nova/instances/ec116f6d-6da0-462b-9c52-55421420c7a0_del complete
Nov 15 01:40:58 user nova-compute[74880]: INFO nova.compute.manager [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 15 01:40:58 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:40:58 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:40:59 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Took 1.00 seconds to deallocate network for instance.
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:40:59 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Deleted allocations for instance ec116f6d-6da0-462b-9c52-55421420c7a0
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c6a16eb5-a2a4-41fd-8563-437534465626 tempest-AttachVolumeNegativeTest-1148149593 tempest-AttachVolumeNegativeTest-1148149593-project-member] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.223s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] Acquiring lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] Lock "ec116f6d-6da0-462b-9c52-55421420c7a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:40:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] No waiting events found dispatching network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:40:59 user nova-compute[74880]: WARNING nova.compute.manager [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received unexpected event network-vif-plugged-0f0f938a-bfbc-4793-9303-f156e46918f1 for instance with vm_state deleted and task_state None.
Nov 15 01:40:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-742a75ce-d9f1-470d-aba2-5fd7a3dd8677 req-f0d4db07-9174-4dc9-88fe-b4c6f157b60c service nova] [instance: ec116f6d-6da0-462b-9c52-55421420c7a0] Received event network-vif-deleted-0f0f938a-bfbc-4793-9303-f156e46918f1 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:41:00 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [{"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-0b109ea6-ed08-4813-abe4-1cbcbdd35c32" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:01 user nova-compute[74880]: INFO nova.compute.manager [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Terminating instance
Nov 15 01:41:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-d4dd41d7-6b0c-490f-af1a-1e9a27ff9d0c req-929d7c0f-194b-42b5-869b-88b352a696df service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-vif-unplugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d4dd41d7-6b0c-490f-af1a-1e9a27ff9d0c req-929d7c0f-194b-42b5-869b-88b352a696df service nova] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d4dd41d7-6b0c-490f-af1a-1e9a27ff9d0c req-929d7c0f-194b-42b5-869b-88b352a696df service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d4dd41d7-6b0c-490f-af1a-1e9a27ff9d0c req-929d7c0f-194b-42b5-869b-88b352a696df service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-d4dd41d7-6b0c-490f-af1a-1e9a27ff9d0c req-929d7c0f-194b-42b5-869b-88b352a696df service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] No waiting events found dispatching network-vif-unplugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-d4dd41d7-6b0c-490f-af1a-1e9a27ff9d0c req-929d7c0f-194b-42b5-869b-88b352a696df service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-vif-unplugged-88e605e7-06ac-498d-9ba9-6432b781d68d for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Instance destroyed successfully.
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'resources' on Instance uuid 9beee7a8-c7eb-45bd-8080-a802365f0029 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:31:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-57320980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-57320980',id=39,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:31:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-yds9mxx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:33:37Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=9beee7a8-c7eb-45bd-8080-a802365f0029,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "88e605e7-06ac-498d-9ba9-6432b781d68d", "address": "fa:16:3e:c6:a2:ce", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e605e7-06", "ovs_interfaceid": "88e605e7-06ac-498d-9ba9-6432b781d68d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG os_vif [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88e605e7-06, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbd237f3-fa7f-4118-85a5-91f20665de5f) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:02 user nova-compute[74880]: INFO os_vif [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:a2:ce,bridge_name='br-int',has_traffic_filtering=True,id=88e605e7-06ac-498d-9ba9-6432b781d68d,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e605e7-06')
Nov 15 01:41:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Deleting instance files /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029_del
Nov 15 01:41:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Deletion of /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029_del complete
Nov 15 01:41:02 user nova-compute[74880]: INFO nova.compute.manager [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json" returned: 1 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk --force-share --output=json' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:41:02 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000027, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/9beee7a8-c7eb-45bd-8080-a802365f0029/disk
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:41:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:41:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:41:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=25.227027893066406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9beee7a8-c7eb-45bd-8080-a802365f0029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance cdd9a3ed-60f6-4802-bea1-ec631dc91818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance afd8f7ab-8f22-4e4d-b474-66655783eb82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:03 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Took 0.98 seconds to deallocate network for instance.
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.manager [req-862e3ea3-742c-4b23-8120-f9739db02327 req-3c14b4ce-8515-442c-9dd8-bbdf775329bd service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-vif-deleted-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:03 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Deleted allocations for instance 9beee7a8-c7eb-45bd-8080-a802365f0029
Nov 15 01:41:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9d81a7c3-36d9-42df-acbf-35f1abd308b3 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-32d5be4f-74d9-44ef-a05d-888209537a88 req-223a46e2-9064-4938-98e1-2277959beb18 service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received event network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-32d5be4f-74d9-44ef-a05d-888209537a88 req-223a46e2-9064-4938-98e1-2277959beb18 service nova] Acquiring lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-32d5be4f-74d9-44ef-a05d-888209537a88 req-223a46e2-9064-4938-98e1-2277959beb18 service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-32d5be4f-74d9-44ef-a05d-888209537a88 req-223a46e2-9064-4938-98e1-2277959beb18 service nova] Lock "9beee7a8-c7eb-45bd-8080-a802365f0029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-32d5be4f-74d9-44ef-a05d-888209537a88 req-223a46e2-9064-4938-98e1-2277959beb18 service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] No waiting events found dispatching network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:04 user nova-compute[74880]: WARNING nova.compute.manager [req-32d5be4f-74d9-44ef-a05d-888209537a88 req-223a46e2-9064-4938-98e1-2277959beb18 service nova] [instance: 9beee7a8-c7eb-45bd-8080-a802365f0029] Received unexpected event network-vif-plugged-88e605e7-06ac-498d-9ba9-6432b781d68d for instance with vm_state deleted and task_state None.
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:41:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:41:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:41:06 user nova-compute[74880]: INFO nova.compute.claims [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Claim successful on node user
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:41:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:41:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Creating image(s)
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG nova.policy [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e673708299e44c4dbe871e7fd1cf0dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889c4a61c654c9b90461d7c8f39473f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk 1073741824" returned: 0 in 0.054s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Cannot resize image /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Ensure instance console log exists: /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Successfully created port: 3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:41:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Successfully updated port: 3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing instance network info cache due to event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance network_info: |[{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Start _get_guest_xml network_info=[{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:41:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:41:08 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-149833206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-149833206',id=49,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhxaCLi5v6M9gFB57ePaRa0VruxJFgbYR2QhQHyMVD88X65p6o7AoqAwBYbS5+G9SFpOF1Ax2/Z2Js5mXWPhzgRSF5RIdBuiSAeBsqMlcgIc7aWonkY2OmY7M4ek/emg==',key_name='tempest-keypair-1793936421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-zykz0kys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=d3032dff-77b2-47b2-a7f4-c5f997763e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'pci_devices' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:41:08 user nova-compute[74880]:   <uuid>d3032dff-77b2-47b2-a7f4-c5f997763e26</uuid>
Nov 15 01:41:08 user nova-compute[74880]:   <name>instance-00000031</name>
Nov 15 01:41:08 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:41:08 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:41:08 user nova-compute[74880]:   <metadata>
Nov 15 01:41:08 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:41:08 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:41:08 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-149833206</nova:name>
Nov 15 01:41:08 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:41:08</nova:creationTime>
Nov 15 01:41:08 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:41:08 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:41:08 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:41:08 user nova-compute[74880]:       <nova:owner>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:user uuid="e673708299e44c4dbe871e7fd1cf0dd4">tempest-AttachVolumeShelveTestJSON-1373123325-project-member</nova:user>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:project uuid="b889c4a61c654c9b90461d7c8f39473f">tempest-AttachVolumeShelveTestJSON-1373123325</nova:project>
Nov 15 01:41:08 user nova-compute[74880]:       </nova:owner>
Nov 15 01:41:08 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:41:08 user nova-compute[74880]:       <nova:ports>
Nov 15 01:41:08 user nova-compute[74880]:         <nova:port uuid="3d4875d6-5ffe-4540-a520-3d69430cfe90">
Nov 15 01:41:08 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:41:08 user nova-compute[74880]:         </nova:port>
Nov 15 01:41:08 user nova-compute[74880]:       </nova:ports>
Nov 15 01:41:08 user nova-compute[74880]:     </nova:instance>
Nov 15 01:41:08 user nova-compute[74880]:   </metadata>
Nov 15 01:41:08 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:41:08 user nova-compute[74880]:     <system>
Nov 15 01:41:08 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:41:08 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:41:08 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:41:08 user nova-compute[74880]:       <entry name="serial">d3032dff-77b2-47b2-a7f4-c5f997763e26</entry>
Nov 15 01:41:08 user nova-compute[74880]:       <entry name="uuid">d3032dff-77b2-47b2-a7f4-c5f997763e26</entry>
Nov 15 01:41:08 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:41:08 user nova-compute[74880]:     </system>
Nov 15 01:41:08 user nova-compute[74880]:   </sysinfo>
Nov 15 01:41:08 user nova-compute[74880]:   <os>
Nov 15 01:41:08 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:41:08 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:41:08 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:41:08 user nova-compute[74880]:   </os>
Nov 15 01:41:08 user nova-compute[74880]:   <features>
Nov 15 01:41:08 user nova-compute[74880]:     <acpi/>
Nov 15 01:41:08 user nova-compute[74880]:     <apic/>
Nov 15 01:41:08 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:41:08 user nova-compute[74880]:   </features>
Nov 15 01:41:08 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:41:08 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:41:08 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:41:08 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:41:08 user nova-compute[74880]:   </clock>
Nov 15 01:41:08 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:41:08 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:41:08 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:41:08 user nova-compute[74880]:   </cpu>
Nov 15 01:41:08 user nova-compute[74880]:   <devices>
Nov 15 01:41:08 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:41:08 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:41:08 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk"/>
Nov 15 01:41:08 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:41:08 user nova-compute[74880]:     </disk>
Nov 15 01:41:08 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:41:08 user nova-compute[74880]:       <mac address="fa:16:3e:97:91:48"/>
Nov 15 01:41:08 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:41:08 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:41:08 user nova-compute[74880]:       <target dev="tap3d4875d6-5f"/>
Nov 15 01:41:08 user nova-compute[74880]:     </interface>
Nov 15 01:41:08 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:41:08 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/console.log" append="off"/>
Nov 15 01:41:08 user nova-compute[74880]:     </serial>
Nov 15 01:41:08 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:41:08 user nova-compute[74880]:     <video>
Nov 15 01:41:08 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:41:08 user nova-compute[74880]:     </video>
Nov 15 01:41:08 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:41:08 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:41:08 user nova-compute[74880]:     </rng>
Nov 15 01:41:08 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:41:08 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:41:08 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:41:08 user nova-compute[74880]:     </memballoon>
Nov 15 01:41:08 user nova-compute[74880]:   </devices>
Nov 15 01:41:08 user nova-compute[74880]: </domain>
Nov 15 01:41:08 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-149833206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-149833206',id=49,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhxaCLi5v6M9gFB57ePaRa0VruxJFgbYR2QhQHyMVD88X65p6o7AoqAwBYbS5+G9SFpOF1Ax2/Z2Js5mXWPhzgRSF5RIdBuiSAeBsqMlcgIc7aWonkY2OmY7M4ek/emg==',key_name='tempest-keypair-1793936421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-zykz0kys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=d3032dff-77b2-47b2-a7f4-c5f997763e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG os_vif [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44c63ab2-6ea1-551f-9f15-3198a7ada307', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d4875d6-5f, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d4875d6-5f, col_values=(('qos', UUID('41ebb5da-c8b3-45aa-8826-f27db263d24b')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d4875d6-5f, col_values=(('external_ids', {'iface-id': '3d4875d6-5ffe-4540-a520-3d69430cfe90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:91:48', 'vm-uuid': 'd3032dff-77b2-47b2-a7f4-c5f997763e26'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:08 user nova-compute[74880]: INFO os_vif [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f')
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No VIF found with MAC fa:16:3e:97:91:48, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updated VIF entry in instance network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG nova.network.neutron [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-97cdccb2-2dab-412d-afdd-8087a4d2b8d2 req-cdd9b564-7024-4cda-ab9f-b27121268e7d service nova] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:41:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-75a2ab3b-5056-4303-8e94-01bbfd406213 req-870e7cbe-20e1-4adc-b267-826817d2e6dd service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-75a2ab3b-5056-4303-8e94-01bbfd406213 req-870e7cbe-20e1-4adc-b267-826817d2e6dd service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-75a2ab3b-5056-4303-8e94-01bbfd406213 req-870e7cbe-20e1-4adc-b267-826817d2e6dd service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-75a2ab3b-5056-4303-8e94-01bbfd406213 req-870e7cbe-20e1-4adc-b267-826817d2e6dd service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:10 user nova-compute[74880]: DEBUG nova.compute.manager [req-75a2ab3b-5056-4303-8e94-01bbfd406213 req-870e7cbe-20e1-4adc-b267-826817d2e6dd service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:10 user nova-compute[74880]: WARNING nova.compute.manager [req-75a2ab3b-5056-4303-8e94-01bbfd406213 req-870e7cbe-20e1-4adc-b267-826817d2e6dd service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state building and task_state spawning.
Nov 15 01:41:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:41:12 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance spawned successfully.
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-5eef4654-be90-4d24-abfe-5c9b0af9d5c1 req-c64c5214-3d09-4e51-8f4c-15f5689afa64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5eef4654-be90-4d24-abfe-5c9b0af9d5c1 req-c64c5214-3d09-4e51-8f4c-15f5689afa64 service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5eef4654-be90-4d24-abfe-5c9b0af9d5c1 req-c64c5214-3d09-4e51-8f4c-15f5689afa64 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5eef4654-be90-4d24-abfe-5c9b0af9d5c1 req-c64c5214-3d09-4e51-8f4c-15f5689afa64 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.compute.manager [req-5eef4654-be90-4d24-abfe-5c9b0af9d5c1 req-c64c5214-3d09-4e51-8f4c-15f5689afa64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:12 user nova-compute[74880]: WARNING nova.compute.manager [req-5eef4654-be90-4d24-abfe-5c9b0af9d5c1 req-c64c5214-3d09-4e51-8f4c-15f5689afa64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state building and task_state spawning.
Nov 15 01:41:12 user nova-compute[74880]: INFO nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 15 01:41:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:41:12 user nova-compute[74880]: INFO nova.compute.manager [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Took 6.26 seconds to build instance.
Nov 15 01:41:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b05207e8-7f12-49ff-bd08-aef1e331d563 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.356s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:52 user nova-compute[74880]: INFO nova.compute.manager [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Terminating instance
Nov 15 01:41:52 user nova-compute[74880]: DEBUG nova.compute.manager [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-1d6119e4-c815-4c29-aaa0-c40b20f14c3e req-1f7d8a42-3495-4ade-a94d-007b571231a6 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1d6119e4-c815-4c29-aaa0-c40b20f14c3e req-1f7d8a42-3495-4ade-a94d-007b571231a6 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1d6119e4-c815-4c29-aaa0-c40b20f14c3e req-1f7d8a42-3495-4ade-a94d-007b571231a6 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-1d6119e4-c815-4c29-aaa0-c40b20f14c3e req-1f7d8a42-3495-4ade-a94d-007b571231a6 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-1d6119e4-c815-4c29-aaa0-c40b20f14c3e req-1f7d8a42-3495-4ade-a94d-007b571231a6 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG nova.compute.manager [req-1d6119e4-c815-4c29-aaa0-c40b20f14c3e req-1f7d8a42-3495-4ade-a94d-007b571231a6 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-unplugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:53 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Instance destroyed successfully.
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.objects.instance [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'resources' on Instance uuid 8bc89cdc-b0df-44cb-87fe-daefba1fea88 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2136740006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2136740006',id=31,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-rs6swch3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:29:53Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=8bc89cdc-b0df-44cb-87fe-daefba1fea88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "address": "fa:16:3e:42:63:13", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf1c4f-87", "ovs_interfaceid": "dccf1c4f-87ec-42b8-97d5-21d7dd01c98e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_vif [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdccf1c4f-87, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36bfcd19-57cc-48ed-978e-6667248d10ff) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:53 user nova-compute[74880]: INFO os_vif [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:63:13,bridge_name='br-int',has_traffic_filtering=True,id=dccf1c4f-87ec-42b8-97d5-21d7dd01c98e,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf1c4f-87')
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYFdENzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:41:53 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38c5a70-b122-4cf7-9718-f94b687225a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:41:53 user nova-compute[74880]: No targets found.
Nov 15 01:41:53 user nova-compute[74880]: iSNS:
Nov 15 01:41:53 user nova-compute[74880]: No targets found.
Nov 15 01:41:53 user nova-compute[74880]: STATIC:
Nov 15 01:41:53 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:41:53 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:41:53 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:41:53 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e
Nov 15 01:41:53 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:41:53 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:41:53 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae
Nov 15 01:41:53 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:41:53 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:41:53 user nova-compute[74880]: FIRMWARE:
Nov 15 01:41:53 user nova-compute[74880]: No targets found.
Nov 15 01:41:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:41:53 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:41:53 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb93b208-ded3-4569-83ba-6b915ef3863a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f18217f-5367-4e65-8125-98032cf375dc]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:41:53 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:41:53 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:41:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e (non-flash)
Nov 15 01:41:53 user nova-compute[74880]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:41:53 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:41:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f07a4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ecf83-b14b-4c2d-91e9-337c099c69d7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edfa40b-c51e-4b73-9124-d10dd2373f75]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff57382-9452-42ff-8462-e466cac58760]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ef0d8-b23c-45a9-8e33-91cd15900c65]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36f23df-1232-41f6-b8d1-805d3fc1eebb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b4499-9736-4c6e-be5b-f9eaa1f529f6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260]
Nov 15 01:41:53 user nova-compute[74880]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e, portal: 172.16.0.220,3260] successful.
Nov 15 01:41:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa16c6f-b074-4334-bc6c-277eae1ba23e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1d122-db58-41e7-bb61-be22a32ed36b]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] <== disconnect_volume: return (302ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:41:53 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Deleting instance files /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88_del
Nov 15 01:41:53 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Deletion of /opt/stack/data/nova/instances/8bc89cdc-b0df-44cb-87fe-daefba1fea88_del complete
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-changed-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Refreshing instance network info cache due to event network-changed-834970dd-2de9-4700-a41f-823cc66fd686. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] Acquiring lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] Acquired lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Refreshing network info cache for port 834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:41:53 user nova-compute[74880]: INFO nova.compute.manager [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 15 01:41:53 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:41:53 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updated VIF entry in instance network info cache for port 834970dd-2de9-4700-a41f-823cc66fd686. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updating instance_info_cache with network_info: [{"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8fd428b9-eeeb-4469-bf4e-6263cce9f17d req-7a05fa68-83ed-4e6e-ac05-c2c20576f090 service nova] Releasing lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:54 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Took 0.82 seconds to deallocate network for instance.
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-036d740f-d265-4cdf-8b53-d63fc290b589 req-59001f48-3356-4718-9ae0-c1168c734f2c service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-deleted-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:54 user nova-compute[74880]: INFO nova.compute.manager [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Terminating instance
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] Acquiring lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] No waiting events found dispatching network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:54 user nova-compute[74880]: WARNING nova.compute.manager [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Received unexpected event network-vif-plugged-dccf1c4f-87ec-42b8-97d5-21d7dd01c98e for instance with vm_state active and task_state deleting.
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-changed-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.compute.manager [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Refreshing instance network info cache due to event network-changed-834970dd-2de9-4700-a41f-823cc66fd686. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] Acquiring lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] Acquired lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:41:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Refreshing network info cache for port 834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updated VIF entry in instance network info cache for port 834970dd-2de9-4700-a41f-823cc66fd686. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.network.neutron [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updating instance_info_cache with network_info: [{"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Instance destroyed successfully.
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'resources' on Instance uuid afd8f7ab-8f22-4e4d-b474-66655783eb82 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:41:55 user nova-compute[74880]: INFO nova.compute.manager [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 8bc89cdc-b0df-44cb-87fe-daefba1fea88] Took 0.90 seconds to detach 1 volumes for instance.
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-312243951',display_name='tempest-TestVolumeBootPattern-server-312243951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-312243951',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:40:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-on4l3m6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:40:13Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=afd8f7ab-8f22-4e4d-b474-66655783eb82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "834970dd-2de9-4700-a41f-823cc66fd686", "address": "fa:16:3e:e5:9f:40", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834970dd-2d", "ovs_interfaceid": "834970dd-2de9-4700-a41f-823cc66fd686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_vif [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-68d4e31e-ea6a-417c-aa7f-65bedb047cb0 req-772955c8-2ecf-4dd1-aac9-957401817212 service nova] Releasing lock "refresh_cache-afd8f7ab-8f22-4e4d-b474-66655783eb82" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap834970dd-2d, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7852e56-1442-4d5c-b671-0102e3672e76) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:55 user nova-compute[74880]: INFO os_vif [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:9f:40,bridge_name='br-int',has_traffic_filtering=True,id=834970dd-2de9-4700-a41f-823cc66fd686,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834970dd-2d')
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePEGduMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:41:55 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe3ddf8-12ed-465a-b08d-b38782897e25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:41:55 user nova-compute[74880]: No targets found.
Nov 15 01:41:55 user nova-compute[74880]: iSNS:
Nov 15 01:41:55 user nova-compute[74880]: No targets found.
Nov 15 01:41:55 user nova-compute[74880]: STATIC:
Nov 15 01:41:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:41:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:41:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:41:55 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae
Nov 15 01:41:55 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:41:55 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:41:55 user nova-compute[74880]: FIRMWARE:
Nov 15 01:41:55 user nova-compute[74880]: No targets found.
Nov 15 01:41:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:41:55 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:41:55 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc580e84-777e-4c43-9382-cc3c39c910e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2af6c-71c9-443f-8f80-4b6a413856b7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:41:55 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:41:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:41:55 user nova-compute[74880]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae (non-flash)
Nov 15 01:41:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f01dbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae'): ({'sdf'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Removing single pathed devices sdf {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf325d-94f4-4a02-a677-aa9ab9c5cd30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3531c8-1f0c-4a3c-81e3-57ee01422e72]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flushing IO for device /dev/sdf {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[33038b31-12ae-402a-8961-32244f7c7a4a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab0a82d-e573-4d72-aa99-697e23b99a17]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] SCSI volumes sdf have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8911241f', '/dev/disk/by-id/scsi-1SCST_BIO8911241f-ed7365b548efcc73', '/dev/disk/by-id/scsi-26564373336356235') {{(pid=85948) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea11d5c4-fd48-496d-88d3-6a531586a500]: (4, None) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7302d417-a7b5-4497-abbe-3fea78fc3735]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9243b420-ac5c-4aa5-bce9-776e67e161fe]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260]
Nov 15 01:41:55 user nova-compute[74880]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae, portal: 172.16.0.220,3260] successful.
Nov 15 01:41:55 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f02c9ea-2f8f-435f-88c5-67f11e4053ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[68144676-ae49-4e6d-899e-0483abf514f5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== disconnect_volume: return (341ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:41:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Deleting instance files /opt/stack/data/nova/instances/afd8f7ab-8f22-4e4d-b474-66655783eb82_del
Nov 15 01:41:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Deletion of /opt/stack/data/nova/instances/afd8f7ab-8f22-4e4d-b474-66655783eb82_del complete
Nov 15 01:41:55 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Deleted allocations for instance 8bc89cdc-b0df-44cb-87fe-daefba1fea88
Nov 15 01:41:55 user nova-compute[74880]: INFO nova.compute.manager [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:41:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-363840f9-b790-4850-b026-81d2173f1702 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "8bc89cdc-b0df-44cb-87fe-daefba1fea88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.521s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:41:56 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Took 0.69 seconds to deallocate network for instance.
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-34ed1a3c-6a6c-41d0-bca8-1d50c9f6d4d2 req-d8ed143b-9af9-427f-8cbf-3d23a8f56563 service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-vif-deleted-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-vif-unplugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] No waiting events found dispatching network-vif-unplugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-vif-unplugged-834970dd-2de9-4700-a41f-823cc66fd686 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received event network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] Acquiring lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] No waiting events found dispatching network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:41:56 user nova-compute[74880]: WARNING nova.compute.manager [req-6545f378-c816-41c6-a9ec-01a73412350f req-f31a4bd7-e5bd-4771-b3ac-e2894330b4eb service nova] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Received unexpected event network-vif-plugged-834970dd-2de9-4700-a41f-823cc66fd686 for instance with vm_state active and task_state deleting.
Nov 15 01:41:57 user nova-compute[74880]: INFO nova.compute.manager [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: afd8f7ab-8f22-4e4d-b474-66655783eb82] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 01:41:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:41:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:41:57 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:41:57 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:41:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:57 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Deleted allocations for instance afd8f7ab-8f22-4e4d-b474-66655783eb82
Nov 15 01:41:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c30787ad-5953-4b42-9996-325cbcea6b59 tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "afd8f7ab-8f22-4e4d-b474-66655783eb82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.108s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:41:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:41:59 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:01 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:42:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:42:01 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:42:01 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating instance_info_cache with network_info: [{"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:42:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:42:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=25.223838806152344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance cdd9a3ed-60f6-4802-bea1-ec631dc91818 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d3032dff-77b2-47b2-a7f4-c5f997763e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:42:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:42:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:42:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5145 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:42:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:42:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:42:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:43 user nova-compute[74880]: INFO nova.compute.manager [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Terminating instance
Nov 15 01:42:43 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-2868e5b8-e55c-4df6-8cc1-28549bdb1488 req-ad0131eb-4231-4a72-bb9d-b2788ef86ed4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-vif-unplugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2868e5b8-e55c-4df6-8cc1-28549bdb1488 req-ad0131eb-4231-4a72-bb9d-b2788ef86ed4 service nova] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2868e5b8-e55c-4df6-8cc1-28549bdb1488 req-ad0131eb-4231-4a72-bb9d-b2788ef86ed4 service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2868e5b8-e55c-4df6-8cc1-28549bdb1488 req-ad0131eb-4231-4a72-bb9d-b2788ef86ed4 service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-2868e5b8-e55c-4df6-8cc1-28549bdb1488 req-ad0131eb-4231-4a72-bb9d-b2788ef86ed4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] No waiting events found dispatching network-vif-unplugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:42:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-2868e5b8-e55c-4df6-8cc1-28549bdb1488 req-ad0131eb-4231-4a72-bb9d-b2788ef86ed4 service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-vif-unplugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Instance destroyed successfully.
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lazy-loading 'resources' on Instance uuid 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132287468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132287468',id=26,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069cac8f31694b1abcac7d3cfaac76ed',ramdisk_id='',reservation_id='r-67ya976u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-330586401',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:25:03Z,user_data=None,user_id='d34159a5cea6426f8e4303dbf20a99af',uuid=0b109ea6-ed08-4813-abe4-1cbcbdd35c32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converting VIF {"id": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "address": "fa:16:3e:86:d5:9c", "network": {"id": "ce91e375-b316-4d60-b1c5-6163cef33315", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1216050797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069cac8f31694b1abcac7d3cfaac76ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a215f8-fb", "ovs_interfaceid": "45a215f8-fb46-43a0-8c6c-f9f071fcc6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG os_vif [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45a215f8-fb, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f365c9e1-797c-4694-a312-b50d8d428011) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:44 user nova-compute[74880]: INFO os_vif [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2,network=Network(ce91e375-b316-4d60-b1c5-6163cef33315),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a215f8-fb')
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Deleting instance files /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32_del
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Deletion of /opt/stack/data/nova/instances/0b109ea6-ed08-4813-abe4-1cbcbdd35c32_del complete
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.compute.manager [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 01:42:44 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Took 0.55 seconds to deallocate network for instance.
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-05add924-b9a0-473b-a252-203343515df7 req-b2569366-57dd-4912-9b17-422d0ef986ac service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-vif-deleted-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.compute.manager [req-05add924-b9a0-473b-a252-203343515df7 req-b2569366-57dd-4912-9b17-422d0ef986ac service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Neutron deleted interface 45a215f8-fb46-43a0-8c6c-f9f071fcc6a2; detaching it from the instance and deleting it from the info cache
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.network.neutron [req-05add924-b9a0-473b-a252-203343515df7 req-b2569366-57dd-4912-9b17-422d0ef986ac service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-05add924-b9a0-473b-a252-203343515df7 req-b2569366-57dd-4912-9b17-422d0ef986ac service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Detach interface failed, port_id=45a215f8-fb46-43a0-8c6c-f9f071fcc6a2, reason: Instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32 could not be found. {{(pid=74880) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:42:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:44 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Deleted allocations for instance 0b109ea6-ed08-4813-abe4-1cbcbdd35c32
Nov 15 01:42:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d67b9a7c-fd39-49e8-8455-f4866e920795 tempest-ServerBootFromVolumeStableRescueTest-330586401 tempest-ServerBootFromVolumeStableRescueTest-330586401-project-member] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.786s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-6f0c3f74-1112-410d-8c56-47029f49f7f9 req-b8beac4b-c992-48d1-9fa3-485dca9ac42f service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received event network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6f0c3f74-1112-410d-8c56-47029f49f7f9 req-b8beac4b-c992-48d1-9fa3-485dca9ac42f service nova] Acquiring lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6f0c3f74-1112-410d-8c56-47029f49f7f9 req-b8beac4b-c992-48d1-9fa3-485dca9ac42f service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6f0c3f74-1112-410d-8c56-47029f49f7f9 req-b8beac4b-c992-48d1-9fa3-485dca9ac42f service nova] Lock "0b109ea6-ed08-4813-abe4-1cbcbdd35c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-6f0c3f74-1112-410d-8c56-47029f49f7f9 req-b8beac4b-c992-48d1-9fa3-485dca9ac42f service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] No waiting events found dispatching network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:42:45 user nova-compute[74880]: WARNING nova.compute.manager [req-6f0c3f74-1112-410d-8c56-47029f49f7f9 req-b8beac4b-c992-48d1-9fa3-485dca9ac42f service nova] [instance: 0b109ea6-ed08-4813-abe4-1cbcbdd35c32] Received unexpected event network-vif-plugged-45a215f8-fb46-43a0-8c6c-f9f071fcc6a2 for instance with vm_state deleted and task_state None.
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-changed-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Refreshing instance network info cache due to event network-changed-b3698136-315e-4a19-b76a-461c5156facf. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] Acquiring lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] Acquired lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Refreshing network info cache for port b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:49 user nova-compute[74880]: INFO nova.compute.manager [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Terminating instance
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-c5d83b06-d566-4d21-b1a5-7e1b9f80cc49 req-49ae0adc-18cf-436a-8d35-11925eae4f54 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-vif-unplugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c5d83b06-d566-4d21-b1a5-7e1b9f80cc49 req-49ae0adc-18cf-436a-8d35-11925eae4f54 service nova] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c5d83b06-d566-4d21-b1a5-7e1b9f80cc49 req-49ae0adc-18cf-436a-8d35-11925eae4f54 service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c5d83b06-d566-4d21-b1a5-7e1b9f80cc49 req-49ae0adc-18cf-436a-8d35-11925eae4f54 service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-c5d83b06-d566-4d21-b1a5-7e1b9f80cc49 req-49ae0adc-18cf-436a-8d35-11925eae4f54 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] No waiting events found dispatching network-vif-unplugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.compute.manager [req-c5d83b06-d566-4d21-b1a5-7e1b9f80cc49 req-49ae0adc-18cf-436a-8d35-11925eae4f54 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-vif-unplugged-b3698136-315e-4a19-b76a-461c5156facf for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updated VIF entry in instance network info cache for port b3698136-315e-4a19-b76a-461c5156facf. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.network.neutron [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating instance_info_cache with network_info: [{"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-77ef16c0-a6fb-4b41-ba75-3d5e214e3fdd req-32d8a717-537b-474e-ab39-cec93ee97f07 service nova] Releasing lock "refresh_cache-cdd9a3ed-60f6-4802-bea1-ec631dc91818" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:42:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Instance destroyed successfully.
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lazy-loading 'resources' on Instance uuid cdd9a3ed-60f6-4802-bea1-ec631dc91818 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:38:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1865752276',display_name='tempest-TestVolumeBootPattern-server-1865752276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1865752276',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkGtlE0Mw1GV6B9SFH06ljiIv4HC0FA8MCavfeNqO/n6qAqwUqhTVPfr0Blv2Wix8ldNvVz8YTwyzf8J0SB8u/CFtMVINDYEgKOZb8I7U9gzM3YeUjYRUk7Djt0Pa6iaQ==',key_name='tempest-TestVolumeBootPattern-1686073184',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861c2385409b4f5080bf3d81430ddbf0',ramdisk_id='',reservation_id='r-l4b2tq54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1434286508',owner_user_name='tempest-TestVolumeBootPattern-1434286508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:38:15Z,user_data=None,user_id='484f6e472b2c4cb588dfab3cc9d3932a',uuid=cdd9a3ed-60f6-4802-bea1-ec631dc91818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converting VIF {"id": "b3698136-315e-4a19-b76a-461c5156facf", "address": "fa:16:3e:6e:1d:42", "network": {"id": "dd38c268-2f43-4941-8a93-e765f238ca8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-576056500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861c2385409b4f5080bf3d81430ddbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3698136-31", "ovs_interfaceid": "b3698136-315e-4a19-b76a-461c5156facf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_vif [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3698136-31, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0b07de5-d340-4e5a-b941-c0b62ee5813d) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:42:49 user nova-compute[74880]: INFO os_vif [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1d:42,bridge_name='br-int',has_traffic_filtering=True,id=b3698136-315e-4a19-b76a-461c5156facf,network=Network(dd38c268-2f43-4941-8a93-e765f238ca8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3698136-31')
Nov 15 01:42:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WofTJepM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:42:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a595c4-513d-4396-9285-4b47249e9736]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:42:49 user nova-compute[74880]: No targets found.
Nov 15 01:42:49 user nova-compute[74880]: iSNS:
Nov 15 01:42:49 user nova-compute[74880]: No targets found.
Nov 15 01:42:49 user nova-compute[74880]: STATIC:
Nov 15 01:42:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93
Nov 15 01:42:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:42:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:42:49 user nova-compute[74880]: FIRMWARE:
Nov 15 01:42:49 user nova-compute[74880]: No targets found.
Nov 15 01:42:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:42:49 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:42:49 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3de8e7-9260-458d-969a-dca627ee95d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ccb179-580b-4149-be3f-a986e3fbbf30]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:42:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 (non-flash)
Nov 15 01:42:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94f0591990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93'): ({'sde'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Removing single pathed devices sde {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:42:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[09355093-3b0a-4ff0-8ef6-6c45a37003be]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac0332-03d8-4673-b707-87556c6b209d]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Flushing IO for device /dev/sde {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e15173d-2a0f-4a07-92ec-cf1bdb862b02]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[77164357-2a7d-49ac-b981-a80fdf06fdd6]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] SCSI volumes sde have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6eb0a-df19-4655-9ef8-c9e35d79bde8]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[169005c5-d38a-471c-940e-beb8bc4724f1]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260]
Nov 15 01:42:50 user nova-compute[74880]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93, portal: 172.16.0.220,3260] successful.
Nov 15 01:42:50 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03779a9c-ae26-4476-9234-ec2884c41b93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa668b-dc89-4f95-9d7b-05b6dfa04c86]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] <== disconnect_volume: return (313ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:42:50 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Deleting instance files /opt/stack/data/nova/instances/cdd9a3ed-60f6-4802-bea1-ec631dc91818_del
Nov 15 01:42:50 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Deletion of /opt/stack/data/nova/instances/cdd9a3ed-60f6-4802-bea1-ec631dc91818_del complete
Nov 15 01:42:50 user nova-compute[74880]: INFO nova.compute.manager [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 01:42:50 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:42:50 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:42:50 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Took 0.45 seconds to deallocate network for instance.
Nov 15 01:42:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-8fa3e5d2-2cf9-40d8-bbda-6ef8f5bc0e1f req-6bc7877c-0875-4544-942c-e156f3088bbc service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-vif-deleted-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-62072614-babf-4205-9966-d526ddcf85f9 req-cf75ae67-f6df-47fc-8329-6fbf603582db service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received event network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-62072614-babf-4205-9966-d526ddcf85f9 req-cf75ae67-f6df-47fc-8329-6fbf603582db service nova] Acquiring lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-62072614-babf-4205-9966-d526ddcf85f9 req-cf75ae67-f6df-47fc-8329-6fbf603582db service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-62072614-babf-4205-9966-d526ddcf85f9 req-cf75ae67-f6df-47fc-8329-6fbf603582db service nova] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG nova.compute.manager [req-62072614-babf-4205-9966-d526ddcf85f9 req-cf75ae67-f6df-47fc-8329-6fbf603582db service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] No waiting events found dispatching network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:42:51 user nova-compute[74880]: WARNING nova.compute.manager [req-62072614-babf-4205-9966-d526ddcf85f9 req-cf75ae67-f6df-47fc-8329-6fbf603582db service nova] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Received unexpected event network-vif-plugged-b3698136-315e-4a19-b76a-461c5156facf for instance with vm_state active and task_state deleting.
Nov 15 01:42:51 user nova-compute[74880]: INFO nova.compute.manager [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] [instance: cdd9a3ed-60f6-4802-bea1-ec631dc91818] Took 0.95 seconds to detach 1 volumes for instance.
Nov 15 01:42:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:42:51 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:51 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Deleted allocations for instance cdd9a3ed-60f6-4802-bea1-ec631dc91818
Nov 15 01:42:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0b34b8c6-890e-4184-b029-44dc146edc4b tempest-TestVolumeBootPattern-1434286508 tempest-TestVolumeBootPattern-1434286508-project-member] Lock "cdd9a3ed-60f6-4802-bea1-ec631dc91818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.888s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing instance network info cache due to event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:42:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:42:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:42:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:42:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updated VIF entry in instance network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:42:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:42:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-6fe4c987-5e24-4564-99d6-a6c63d09feaa req-5c05d368-a78c-4537-8424-5d14d9a12b01 service nova] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:42:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:59 user nova-compute[74880]: INFO nova.compute.manager [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Shelving
Nov 15 01:42:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-eede3d64-4092-4d56-8891-9496b133bd34 req-73955b02-bd36-4911-ab40-25189af17cba service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-unplugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-eede3d64-4092-4d56-8891-9496b133bd34 req-73955b02-bd36-4911-ab40-25189af17cba service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-eede3d64-4092-4d56-8891-9496b133bd34 req-73955b02-bd36-4911-ab40-25189af17cba service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-eede3d64-4092-4d56-8891-9496b133bd34 req-73955b02-bd36-4911-ab40-25189af17cba service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:42:59 user nova-compute[74880]: DEBUG nova.compute.manager [req-eede3d64-4092-4d56-8891-9496b133bd34 req-73955b02-bd36-4911-ab40-25189af17cba service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-unplugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:42:59 user nova-compute[74880]: WARNING nova.compute.manager [req-eede3d64-4092-4d56-8891-9496b133bd34 req-73955b02-bd36-4911-ab40-25189af17cba service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-unplugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state active and task_state shelving.
Nov 15 01:43:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance destroyed successfully.
Nov 15 01:43:00 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Beginning cold snapshot process
Nov 15 01:43:00 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:43:00 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk /opt/stack/data/nova/instances/snapshots/tmp28rffq_s/3af2fa67cdc44cef9167cbd13aae13f1 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:43:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk /opt/stack/data/nova/instances/snapshots/tmp28rffq_s/3af2fa67cdc44cef9167cbd13aae13f1" returned: 0 in 0.598s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:43:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Snapshot extracted, beginning image upload
Nov 15 01:43:01 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-d068f07d-8fd9-4cfd-a55f-aa2a71070bd4 req-6e1464a3-3eac-44d0-adcb-516b6a9465a1 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d068f07d-8fd9-4cfd-a55f-aa2a71070bd4 req-6e1464a3-3eac-44d0-adcb-516b6a9465a1 service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d068f07d-8fd9-4cfd-a55f-aa2a71070bd4 req-6e1464a3-3eac-44d0-adcb-516b6a9465a1 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d068f07d-8fd9-4cfd-a55f-aa2a71070bd4 req-6e1464a3-3eac-44d0-adcb-516b6a9465a1 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-d068f07d-8fd9-4cfd-a55f-aa2a71070bd4 req-6e1464a3-3eac-44d0-adcb-516b6a9465a1 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:43:02 user nova-compute[74880]: WARNING nova.compute.manager [req-d068f07d-8fd9-4cfd-a55f-aa2a71070bd4 req-6e1464a3-3eac-44d0-adcb-516b6a9465a1 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 01:43:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:43:02 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:43:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:43:03 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.287853240966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:43:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Snapshot image upload complete
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d3032dff-77b2-47b2-a7f4-c5f997763e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:43:03 user nova-compute[74880]: INFO nova.compute.manager [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Shelve offloading
Nov 15 01:43:03 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance destroyed successfully.
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:43:03 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.network.neutron [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:43:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance destroyed successfully.
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'resources' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-149833206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-149833206',id=49,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhxaCLi5v6M9gFB57ePaRa0VruxJFgbYR2QhQHyMVD88X65p6o7AoqAwBYbS5+G9SFpOF1Ax2/Z2Js5mXWPhzgRSF5RIdBuiSAeBsqMlcgIc7aWonkY2OmY7M4ek/emg==',key_name='tempest-keypair-1793936421',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-zykz0kys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member',shelved_at='2023-11-15T01:43:03.651252',shelved_host='user',shelved_image_id='fe65f36c-3198-48bb-bd71-3a63c963f805'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=d3032dff-77b2-47b2-a7f4-c5f997763e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG os_vif [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d4875d6-5f, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41ebb5da-c8b3-45aa-8826-f27db263d24b) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.compute.manager [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing instance network info cache due to event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.network.neutron [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:04 user nova-compute[74880]: INFO os_vif [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f')
Nov 15 01:43:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Deleting instance files /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26_del
Nov 15 01:43:04 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Deletion of /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26_del complete
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:04 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Deleted allocations for instance d3032dff-77b2-47b2-a7f4-c5f997763e26
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'numa_topology' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:43:04 user nova-compute[74880]: DEBUG nova.objects.base [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<d3032dff-77b2-47b2-a7f4-c5f997763e26> lazy-loaded attributes: resources,numa_topology {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b002ec41-0325-4010-9eb1-2a3d49229c43 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.404s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updated VIF entry in instance network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG nova.network.neutron [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-fbfb550e-634b-4962-acd6-c718bbf9bc35 req-1a857ad3-1018-485f-b708-83997d337b64 service nova] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:08 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:43:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:43:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:43:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:43:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:43:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:43:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:43:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:02 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:44:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:44:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:44:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=25.314472198486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:06 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:44:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:44:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:44:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:44:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:44:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:44:39 user nova-compute[74880]: INFO nova.compute.claims [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Claim successful on node user
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:44:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.policy [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc61549e25c4d10b9b8bd0422bdba76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b186a8faa471ab7e009fbe3432923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:44:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Creating image(s)
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "08c31c1ac2ca82da47c97f4493d8360f4b3b6f92" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "08c31c1ac2ca82da47c97f4493d8360f4b3b6f92" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG nova.virt.images [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] e80acad4-8a97-4e0d-b0ca-3e144e361ab9 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.part /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Successfully created port: 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.part /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.converted" returned: 0 in 0.453s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "08c31c1ac2ca82da47c97f4493d8360f4b3b6f92" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.290s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:40 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "08c31c1ac2ca82da47c97f4493d8360f4b3b6f92" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "08c31c1ac2ca82da47c97f4493d8360f4b3b6f92" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Successfully updated port: 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.compute.manager [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing instance network info cache due to event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92,backing_fmt=raw /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92,backing_fmt=raw /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk 1073741824" returned: 0 in 0.084s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "08c31c1ac2ca82da47c97f4493d8360f4b3b6f92" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8e8d172f-277a-4132-9f6e-48f1a4823a23 req-bf64dc1e-06d1-49d2-ac6d-2536b58fb0d6 service nova] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Cannot resize image /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Ensure instance console log exists: /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.neutron [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance network_info: |[{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Start _get_guest_xml network_info=[{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:44:36Z,direct_url=<?>,disk_format='qcow2',id=e80acad4-8a97-4e0d-b0ca-3e144e361ab9,min_disk=0,min_ram=0,name='tempest-scenario-img--1844185697',owner='548b186a8faa471ab7e009fbe3432923',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'e80acad4-8a97-4e0d-b0ca-3e144e361ab9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:44:41 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:44:41 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:44:36Z,direct_url=<?>,disk_format='qcow2',id=e80acad4-8a97-4e0d-b0ca-3e144e361ab9,min_disk=0,min_ram=0,name='tempest-scenario-img--1844185697',owner='548b186a8faa471ab7e009fbe3432923',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-100836865',display_name='tempest-TestMinimumBasicScenario-server-100836865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-100836865',id=50,image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7zICVAyfv2yj+pQI1k5oLkzplJqKI9CUJgsCvEp5t4Zy43SxujZFTCii/nQQIMjvK1JkROTs1fzPTVMGIzz9K66qiXte2Axn7rWshkMUZ7EIs76p+pkDd1z6mmGDns8A==',key_name='tempest-TestMinimumBasicScenario-606559497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-4hjhjwjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:44:40Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=9489a5b9-53a0-4971-8d92-42e8cf43d1d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.objects.instance [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'pci_devices' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:44:41 user nova-compute[74880]:   <uuid>9489a5b9-53a0-4971-8d92-42e8cf43d1d6</uuid>
Nov 15 01:44:41 user nova-compute[74880]:   <name>instance-00000032</name>
Nov 15 01:44:41 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:44:41 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:44:41 user nova-compute[74880]:   <metadata>
Nov 15 01:44:41 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:44:41 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:44:41 user nova-compute[74880]:       <nova:name>tempest-TestMinimumBasicScenario-server-100836865</nova:name>
Nov 15 01:44:41 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:44:41</nova:creationTime>
Nov 15 01:44:41 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:44:41 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:44:41 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:44:41 user nova-compute[74880]:       <nova:owner>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:user uuid="7dc61549e25c4d10b9b8bd0422bdba76">tempest-TestMinimumBasicScenario-2025011480-project-member</nova:user>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:project uuid="548b186a8faa471ab7e009fbe3432923">tempest-TestMinimumBasicScenario-2025011480</nova:project>
Nov 15 01:44:41 user nova-compute[74880]:       </nova:owner>
Nov 15 01:44:41 user nova-compute[74880]:       <nova:root type="image" uuid="e80acad4-8a97-4e0d-b0ca-3e144e361ab9"/>
Nov 15 01:44:41 user nova-compute[74880]:       <nova:ports>
Nov 15 01:44:41 user nova-compute[74880]:         <nova:port uuid="89dc6cac-4f73-4331-92a6-9c8771504199">
Nov 15 01:44:41 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:44:41 user nova-compute[74880]:         </nova:port>
Nov 15 01:44:41 user nova-compute[74880]:       </nova:ports>
Nov 15 01:44:41 user nova-compute[74880]:     </nova:instance>
Nov 15 01:44:41 user nova-compute[74880]:   </metadata>
Nov 15 01:44:41 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:44:41 user nova-compute[74880]:     <system>
Nov 15 01:44:41 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:44:41 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:44:41 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:44:41 user nova-compute[74880]:       <entry name="serial">9489a5b9-53a0-4971-8d92-42e8cf43d1d6</entry>
Nov 15 01:44:41 user nova-compute[74880]:       <entry name="uuid">9489a5b9-53a0-4971-8d92-42e8cf43d1d6</entry>
Nov 15 01:44:41 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:44:41 user nova-compute[74880]:     </system>
Nov 15 01:44:41 user nova-compute[74880]:   </sysinfo>
Nov 15 01:44:41 user nova-compute[74880]:   <os>
Nov 15 01:44:41 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:44:41 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:44:41 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:44:41 user nova-compute[74880]:   </os>
Nov 15 01:44:41 user nova-compute[74880]:   <features>
Nov 15 01:44:41 user nova-compute[74880]:     <acpi/>
Nov 15 01:44:41 user nova-compute[74880]:     <apic/>
Nov 15 01:44:41 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:44:41 user nova-compute[74880]:   </features>
Nov 15 01:44:41 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:44:41 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:44:41 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:44:41 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:44:41 user nova-compute[74880]:   </clock>
Nov 15 01:44:41 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:44:41 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:44:41 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:44:41 user nova-compute[74880]:   </cpu>
Nov 15 01:44:41 user nova-compute[74880]:   <devices>
Nov 15 01:44:41 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:44:41 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:44:41 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk"/>
Nov 15 01:44:41 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:44:41 user nova-compute[74880]:     </disk>
Nov 15 01:44:41 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:44:41 user nova-compute[74880]:       <mac address="fa:16:3e:34:b4:10"/>
Nov 15 01:44:41 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:44:41 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:44:41 user nova-compute[74880]:       <target dev="tap89dc6cac-4f"/>
Nov 15 01:44:41 user nova-compute[74880]:     </interface>
Nov 15 01:44:41 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:44:41 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/console.log" append="off"/>
Nov 15 01:44:41 user nova-compute[74880]:     </serial>
Nov 15 01:44:41 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:44:41 user nova-compute[74880]:     <video>
Nov 15 01:44:41 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:44:41 user nova-compute[74880]:     </video>
Nov 15 01:44:41 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:44:41 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:44:41 user nova-compute[74880]:     </rng>
Nov 15 01:44:41 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:44:41 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:44:41 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:44:41 user nova-compute[74880]:     </memballoon>
Nov 15 01:44:41 user nova-compute[74880]:   </devices>
Nov 15 01:44:41 user nova-compute[74880]: </domain>
Nov 15 01:44:41 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-100836865',display_name='tempest-TestMinimumBasicScenario-server-100836865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-100836865',id=50,image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7zICVAyfv2yj+pQI1k5oLkzplJqKI9CUJgsCvEp5t4Zy43SxujZFTCii/nQQIMjvK1JkROTs1fzPTVMGIzz9K66qiXte2Axn7rWshkMUZ7EIs76p+pkDd1z6mmGDns8A==',key_name='tempest-TestMinimumBasicScenario-606559497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-4hjhjwjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:44:40Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=9489a5b9-53a0-4971-8d92-42e8cf43d1d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG os_vif [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aa2fce4-428e-570a-9076-78576bc85814', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89dc6cac-4f, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89dc6cac-4f, col_values=(('qos', UUID('62c696ca-39b6-4e65-9fb9-8cd78a655f9f')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89dc6cac-4f, col_values=(('external_ids', {'iface-id': '89dc6cac-4f73-4331-92a6-9c8771504199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:b4:10', 'vm-uuid': '9489a5b9-53a0-4971-8d92-42e8cf43d1d6'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:41 user nova-compute[74880]: INFO os_vif [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f')
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:44:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No VIF found with MAC fa:16:3e:34:b4:10, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:44:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-f61c0ce3-5085-413e-8faa-b078a8533359 req-f4a55fab-7316-4f0f-bd5e-15f4996386eb service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f61c0ce3-5085-413e-8faa-b078a8533359 req-f4a55fab-7316-4f0f-bd5e-15f4996386eb service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f61c0ce3-5085-413e-8faa-b078a8533359 req-f4a55fab-7316-4f0f-bd5e-15f4996386eb service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-f61c0ce3-5085-413e-8faa-b078a8533359 req-f4a55fab-7316-4f0f-bd5e-15f4996386eb service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-f61c0ce3-5085-413e-8faa-b078a8533359 req-f4a55fab-7316-4f0f-bd5e-15f4996386eb service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:44:43 user nova-compute[74880]: WARNING nova.compute.manager [req-f61c0ce3-5085-413e-8faa-b078a8533359 req-f4a55fab-7316-4f0f-bd5e-15f4996386eb service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state building and task_state spawning.
Nov 15 01:44:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:44:45 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance spawned successfully.
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:44:45 user nova-compute[74880]: INFO nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-9e324bb2-b4b1-42b0-8335-2cc5f4a7271f req-df06d363-c26a-49b4-8226-364e9cbe698e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9e324bb2-b4b1-42b0-8335-2cc5f4a7271f req-df06d363-c26a-49b4-8226-364e9cbe698e service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9e324bb2-b4b1-42b0-8335-2cc5f4a7271f req-df06d363-c26a-49b4-8226-364e9cbe698e service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9e324bb2-b4b1-42b0-8335-2cc5f4a7271f req-df06d363-c26a-49b4-8226-364e9cbe698e service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-9e324bb2-b4b1-42b0-8335-2cc5f4a7271f req-df06d363-c26a-49b4-8226-364e9cbe698e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:44:45 user nova-compute[74880]: WARNING nova.compute.manager [req-9e324bb2-b4b1-42b0-8335-2cc5f4a7271f req-df06d363-c26a-49b4-8226-364e9cbe698e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state building and task_state spawning.
Nov 15 01:44:45 user nova-compute[74880]: INFO nova.compute.manager [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Took 6.38 seconds to build instance.
Nov 15 01:44:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-d4f7ddb5-2b6b-4e29-8521-e1987bccd502 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.479s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:52 user nova-compute[74880]: INFO nova.compute.manager [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Unshelving
Nov 15 01:44:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG nova.objects.instance [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'pci_requests' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG nova.objects.instance [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'numa_topology' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:44:52 user nova-compute[74880]: INFO nova.compute.claims [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Claim successful on node user
Nov 15 01:44:52 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:52 user nova-compute[74880]: INFO nova.network.neutron [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating port 3d4875d6-5ffe-4540-a520-3d69430cfe90 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 01:44:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing instance network info cache due to event network-changed-3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.network.neutron [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:44:53 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Creating image(s)
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.objects.instance [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.network.neutron [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Refreshing network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG nova.objects.base [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<d3032dff-77b2-47b2-a7f4-c5f997763e26> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "b0b7eb0dca3d9de129004cf3270dd66ee0e263e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "b0b7eb0dca3d9de129004cf3270dd66ee0e263e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG nova.virt.images [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] fe65f36c-3198-48bb-bd71-3a63c963f805 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.part /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updated VIF entry in instance network info cache for port 3d4875d6-5ffe-4540-a520-3d69430cfe90. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG nova.network.neutron [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:44:54 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-28e7f1d8-d0d6-4a0c-b622-87e4f30c7c81 req-b5c65e57-c4ac-4705-b812-3d748292b582 service nova] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.part /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.converted" returned: 0 in 0.437s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "b0b7eb0dca3d9de129004cf3270dd66ee0e263e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.939s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "b0b7eb0dca3d9de129004cf3270dd66ee0e263e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "b0b7eb0dca3d9de129004cf3270dd66ee0e263e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1,backing_fmt=raw /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1,backing_fmt=raw /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk 1073741824" returned: 0 in 0.048s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "b0b7eb0dca3d9de129004cf3270dd66ee0e263e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:55 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 --force-share --output=json" returned: 0 in 0.192s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:56 user nova-compute[74880]: DEBUG nova.objects.instance [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'migration_context' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:56 user nova-compute[74880]: DEBUG nova.objects.base [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<d3032dff-77b2-47b2-a7f4-c5f997763e26> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:44:56 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Rebasing disk image.
Nov 15 01:44:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:56 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 -F raw /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:44:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 -F raw /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk" returned: 0 in 1.982s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Ensure instance console log exists: /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Start _get_guest_xml network_info=[{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1cb3a6e8d68963185f50d53f1f015164',container_format='bare',created_at=2023-11-15T01:43:00Z,direct_url=<?>,disk_format='qcow2',id=fe65f36c-3198-48bb-bd71-3a63c963f805,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-149833206-shelved',owner='b889c4a61c654c9b90461d7c8f39473f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T01:43:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:44:58 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:44:58 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1cb3a6e8d68963185f50d53f1f015164',container_format='bare',created_at=2023-11-15T01:43:00Z,direct_url=<?>,disk_format='qcow2',id=fe65f36c-3198-48bb-bd71-3a63c963f805,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-149833206-shelved',owner='b889c4a61c654c9b90461d7c8f39473f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T01:43:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.objects.instance [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.objects.base [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<d3032dff-77b2-47b2-a7f4-c5f997763e26> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-149833206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-149833206',id=49,image_ref='fe65f36c-3198-48bb-bd71-3a63c963f805',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1793936421',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-zykz0kys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member',shelved_at='2023-11-15T01:43:03.651252',shelved_host='user',shelved_image_id='fe65f36c-3198-48bb-bd71-3a63c963f805'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=d3032dff-77b2-47b2-a7f4-c5f997763e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.objects.instance [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'pci_devices' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.objects.base [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Object Instance<d3032dff-77b2-47b2-a7f4-c5f997763e26> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:44:58 user nova-compute[74880]:   <uuid>d3032dff-77b2-47b2-a7f4-c5f997763e26</uuid>
Nov 15 01:44:58 user nova-compute[74880]:   <name>instance-00000031</name>
Nov 15 01:44:58 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:44:58 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:44:58 user nova-compute[74880]:   <metadata>
Nov 15 01:44:58 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:44:58 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:44:58 user nova-compute[74880]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-149833206</nova:name>
Nov 15 01:44:58 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:44:58</nova:creationTime>
Nov 15 01:44:58 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:44:58 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:44:58 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:44:58 user nova-compute[74880]:       <nova:owner>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:user uuid="e673708299e44c4dbe871e7fd1cf0dd4">tempest-AttachVolumeShelveTestJSON-1373123325-project-member</nova:user>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:project uuid="b889c4a61c654c9b90461d7c8f39473f">tempest-AttachVolumeShelveTestJSON-1373123325</nova:project>
Nov 15 01:44:58 user nova-compute[74880]:       </nova:owner>
Nov 15 01:44:58 user nova-compute[74880]:       <nova:root type="image" uuid="fe65f36c-3198-48bb-bd71-3a63c963f805"/>
Nov 15 01:44:58 user nova-compute[74880]:       <nova:ports>
Nov 15 01:44:58 user nova-compute[74880]:         <nova:port uuid="3d4875d6-5ffe-4540-a520-3d69430cfe90">
Nov 15 01:44:58 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:44:58 user nova-compute[74880]:         </nova:port>
Nov 15 01:44:58 user nova-compute[74880]:       </nova:ports>
Nov 15 01:44:58 user nova-compute[74880]:     </nova:instance>
Nov 15 01:44:58 user nova-compute[74880]:   </metadata>
Nov 15 01:44:58 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:44:58 user nova-compute[74880]:     <system>
Nov 15 01:44:58 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:44:58 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:44:58 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:44:58 user nova-compute[74880]:       <entry name="serial">d3032dff-77b2-47b2-a7f4-c5f997763e26</entry>
Nov 15 01:44:58 user nova-compute[74880]:       <entry name="uuid">d3032dff-77b2-47b2-a7f4-c5f997763e26</entry>
Nov 15 01:44:58 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:44:58 user nova-compute[74880]:     </system>
Nov 15 01:44:58 user nova-compute[74880]:   </sysinfo>
Nov 15 01:44:58 user nova-compute[74880]:   <os>
Nov 15 01:44:58 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:44:58 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:44:58 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:44:58 user nova-compute[74880]:   </os>
Nov 15 01:44:58 user nova-compute[74880]:   <features>
Nov 15 01:44:58 user nova-compute[74880]:     <acpi/>
Nov 15 01:44:58 user nova-compute[74880]:     <apic/>
Nov 15 01:44:58 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:44:58 user nova-compute[74880]:   </features>
Nov 15 01:44:58 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:44:58 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:44:58 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:44:58 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:44:58 user nova-compute[74880]:   </clock>
Nov 15 01:44:58 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:44:58 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:44:58 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:44:58 user nova-compute[74880]:   </cpu>
Nov 15 01:44:58 user nova-compute[74880]:   <devices>
Nov 15 01:44:58 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:44:58 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:44:58 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk"/>
Nov 15 01:44:58 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:44:58 user nova-compute[74880]:     </disk>
Nov 15 01:44:58 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:44:58 user nova-compute[74880]:       <mac address="fa:16:3e:97:91:48"/>
Nov 15 01:44:58 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:44:58 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:44:58 user nova-compute[74880]:       <target dev="tap3d4875d6-5f"/>
Nov 15 01:44:58 user nova-compute[74880]:     </interface>
Nov 15 01:44:58 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:44:58 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/console.log" append="off"/>
Nov 15 01:44:58 user nova-compute[74880]:     </serial>
Nov 15 01:44:58 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:44:58 user nova-compute[74880]:     <video>
Nov 15 01:44:58 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:44:58 user nova-compute[74880]:     </video>
Nov 15 01:44:58 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:44:58 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:44:58 user nova-compute[74880]:     </rng>
Nov 15 01:44:58 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:44:58 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:44:58 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:44:58 user nova-compute[74880]:     </memballoon>
Nov 15 01:44:58 user nova-compute[74880]:   </devices>
Nov 15 01:44:58 user nova-compute[74880]: </domain>
Nov 15 01:44:58 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-149833206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-149833206',id=49,image_ref='fe65f36c-3198-48bb-bd71-3a63c963f805',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1793936421',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-zykz0kys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member',shelved_at='2023-11-15T01:43:03.651252',shelved_host='user',shelved_image_id='fe65f36c-3198-48bb-bd71-3a63c963f805'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=d3032dff-77b2-47b2-a7f4-c5f997763e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG os_vif [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44c63ab2-6ea1-551f-9f15-3198a7ada307', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d4875d6-5f, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d4875d6-5f, col_values=(('qos', UUID('6d180c3d-b543-4228-aa7d-1de6331c5295')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d4875d6-5f, col_values=(('external_ids', {'iface-id': '3d4875d6-5ffe-4540-a520-3d69430cfe90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:91:48', 'vm-uuid': 'd3032dff-77b2-47b2-a7f4-c5f997763e26'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:58 user nova-compute[74880]: INFO os_vif [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f')
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:44:58 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] No VIF found with MAC fa:16:3e:97:91:48, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:44:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:44:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-92025826-c41b-4953-a24b-3d29e0368879 req-170164bd-bc88-4b51-8bb9-32d05317a246 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-92025826-c41b-4953-a24b-3d29e0368879 req-170164bd-bc88-4b51-8bb9-32d05317a246 service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-92025826-c41b-4953-a24b-3d29e0368879 req-170164bd-bc88-4b51-8bb9-32d05317a246 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-92025826-c41b-4953-a24b-3d29e0368879 req-170164bd-bc88-4b51-8bb9-32d05317a246 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG nova.compute.manager [req-92025826-c41b-4953-a24b-3d29e0368879 req-170164bd-bc88-4b51-8bb9-32d05317a246 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:45:00 user nova-compute[74880]: WARNING nova.compute.manager [req-92025826-c41b-4953-a24b-3d29e0368879 req-170164bd-bc88-4b51-8bb9-32d05317a246 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 01:45:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:45:02 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance spawned successfully.
Nov 15 01:45:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-82e0ab14-be41-4dfc-b3b3-ba79eacbdbdc req-e9415501-136e-4acb-9853-3e2f1ab64d9e service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-82e0ab14-be41-4dfc-b3b3-ba79eacbdbdc req-e9415501-136e-4acb-9853-3e2f1ab64d9e service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-82e0ab14-be41-4dfc-b3b3-ba79eacbdbdc req-e9415501-136e-4acb-9853-3e2f1ab64d9e service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-82e0ab14-be41-4dfc-b3b3-ba79eacbdbdc req-e9415501-136e-4acb-9853-3e2f1ab64d9e service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG nova.compute.manager [req-82e0ab14-be41-4dfc-b3b3-ba79eacbdbdc req-e9415501-136e-4acb-9853-3e2f1ab64d9e service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:45:02 user nova-compute[74880]: WARNING nova.compute.manager [req-82e0ab14-be41-4dfc-b3b3-ba79eacbdbdc req-e9415501-136e-4acb-9853-3e2f1ab64d9e service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 01:45:02 user nova-compute[74880]: DEBUG nova.compute.manager [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-50ea15ad-28ad-4302-b3ed-02450766c255 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.178s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:45:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:45:03 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:45:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:45:04 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:45:04 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=25.19055938720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:45:04 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d3032dff-77b2-47b2-a7f4-c5f997763e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:45:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:45:06 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:45:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [{"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:45:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-d3032dff-77b2-47b2-a7f4-c5f997763e26" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:45:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:45:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:08 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:45:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:45:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:45:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:45:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:45:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:45:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:45:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:45:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:45:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:46:05 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:06 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:46:06 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:46:06 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.18804168701172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance d3032dff-77b2-47b2-a7f4-c5f997763e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:46:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:12 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:46:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:46:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:46:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:46:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:19 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:46:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'flavor' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:31 user nova-compute[74880]: INFO nova.compute.manager [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Attaching volume 21208614-0f9c-4621-a38b-32a14656d37f to /dev/vdb
Nov 15 01:46:31 user nova-compute[74880]: DEBUG os_brick.utils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b1dbc-0247-4d04-be2b-e6d5487658db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d97a5cb-8885-41cd-9418-04e6fd976495]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eabc867-3308-4e28-8221-e7694fe95635]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9747515-e0d2-45f0-8873-5e720d144169]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:46:31 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:46:31 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2a355a-21f3-408c-98a9-1754e6b5c5ee]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG os_brick.utils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:46:31 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating existing volume attachment record: 77ef3ca8-736b-48e3-b9ee-d6076482973d {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:46:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:46:36 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:46:36 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:46:36 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[439029b1-5d62-44be-a216-70ad56ffe23e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:46:36 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a6ca2-5539-492e-ad9e-07b3f22ba006]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f] added
Nov 15 01:46:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608e514-6bc3-4a1c-bb35-baf7a6c7269e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad45eb-d740-485e-999e-53455889631a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRTyzPNb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRTyzPNb" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1991a3d8-e173-45ea-8981-c64cca796a82]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRTyzPNb'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b483629-0677-4d23-987a-169d22942518]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[197135b0-01e3-4ace-9155-238a2c0bdac0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:46:36 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:46:36 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:46:36 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 01:46:36 user nova-compute[74880]: 
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d3890d-763b-41af-a5bf-16738f5c4046]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]
Nov 15 01:46:36 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.
Nov 15 01:46:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[569405d4-88b5-43c0-b5a7-0a8b9a608491]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19421a6-4662-4615-9439-2ef4481bada1]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:46:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:46:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c664c9-c5ac-4fa0-89e9-a2eeb2e0ce6f]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26361376631656234', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361376631656234', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG nova.objects.instance [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'flavor' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:37 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:46:37 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:46:37 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:46:37 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:46:37 user nova-compute[74880]:   <serial>21208614-0f9c-4621-a38b-32a14656d37f</serial>
Nov 15 01:46:37 user nova-compute[74880]: </disk>
Nov 15 01:46:37 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No VIF found with MAC fa:16:3e:34:b4:10, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-f3358d33-1133-4580-8b95-d36adb312461 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.505s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:46:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:42 user nova-compute[74880]: INFO nova.compute.manager [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Terminating instance
Nov 15 01:46:42 user nova-compute[74880]: DEBUG nova.compute.manager [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-47de9250-ccdf-4d71-83ee-8177411838cd req-f80fb406-a432-4c94-a9ee-803c002ef9b1 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-unplugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-47de9250-ccdf-4d71-83ee-8177411838cd req-f80fb406-a432-4c94-a9ee-803c002ef9b1 service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-47de9250-ccdf-4d71-83ee-8177411838cd req-f80fb406-a432-4c94-a9ee-803c002ef9b1 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-47de9250-ccdf-4d71-83ee-8177411838cd req-f80fb406-a432-4c94-a9ee-803c002ef9b1 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-47de9250-ccdf-4d71-83ee-8177411838cd req-f80fb406-a432-4c94-a9ee-803c002ef9b1 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-unplugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.compute.manager [req-47de9250-ccdf-4d71-83ee-8177411838cd req-f80fb406-a432-4c94-a9ee-803c002ef9b1 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-unplugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Instance destroyed successfully.
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.objects.instance [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lazy-loading 'resources' on Instance uuid d3032dff-77b2-47b2-a7f4-c5f997763e26 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T01:41:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-149833206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-149833206',id=49,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIhxaCLi5v6M9gFB57ePaRa0VruxJFgbYR2QhQHyMVD88X65p6o7AoqAwBYbS5+G9SFpOF1Ax2/Z2Js5mXWPhzgRSF5RIdBuiSAeBsqMlcgIc7aWonkY2OmY7M4ek/emg==',key_name='tempest-keypair-1793936421',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b889c4a61c654c9b90461d7c8f39473f',ramdisk_id='',reservation_id='r-zykz0kys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1373123325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1373123325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e673708299e44c4dbe871e7fd1cf0dd4',uuid=d3032dff-77b2-47b2-a7f4-c5f997763e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converting VIF {"id": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "address": "fa:16:3e:97:91:48", "network": {"id": "e28eb842-9bf2-4a2b-b664-17ea21dbceda", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-114398820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889c4a61c654c9b90461d7c8f39473f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d4875d6-5f", "ovs_interfaceid": "3d4875d6-5ffe-4540-a520-3d69430cfe90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG os_vif [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d4875d6-5f, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d180c3d-b543-4228-aa7d-1de6331c5295) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:43 user nova-compute[74880]: INFO os_vif [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:91:48,bridge_name='br-int',has_traffic_filtering=True,id=3d4875d6-5ffe-4540-a520-3d69430cfe90,network=Network(e28eb842-9bf2-4a2b-b664-17ea21dbceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d4875d6-5f')
Nov 15 01:46:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Deleting instance files /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26_del
Nov 15 01:46:43 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Deletion of /opt/stack/data/nova/instances/d3032dff-77b2-47b2-a7f4-c5f997763e26_del complete
Nov 15 01:46:43 user nova-compute[74880]: INFO nova.compute.manager [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 01:46:43 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:46:43 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:46:44 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:46:44 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Took 0.79 seconds to deallocate network for instance.
Nov 15 01:46:44 user nova-compute[74880]: DEBUG nova.compute.manager [req-655b995f-9da7-456a-bcf0-06efed58e092 req-eac9c02f-9c67-40be-85c4-81e1cea7795d service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-deleted-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:44 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:46:44 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:46:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:44 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Deleted allocations for instance d3032dff-77b2-47b2-a7f4-c5f997763e26
Nov 15 01:46:44 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-650d9768-4568-4da9-9d7f-44b6aa653d46 tempest-AttachVolumeShelveTestJSON-1373123325 tempest-AttachVolumeShelveTestJSON-1373123325-project-member] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] Acquiring lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] Lock "d3032dff-77b2-47b2-a7f4-c5f997763e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] No waiting events found dispatching network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:46:45 user nova-compute[74880]: WARNING nova.compute.manager [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: d3032dff-77b2-47b2-a7f4-c5f997763e26] Received unexpected event network-vif-plugged-3d4875d6-5ffe-4540-a520-3d69430cfe90 for instance with vm_state deleted and task_state None.
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing instance network info cache due to event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated VIF entry in instance network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-4a29d28b-d1ab-46a8-ac25-3442ebcafffd req-c9d5e0b5-dd43-44c7-a8ea-937f1ada8a82 service nova] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.compute.manager [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing instance network info cache due to event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:46:45 user nova-compute[74880]: DEBUG nova.network.neutron [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:46:46 user nova-compute[74880]: DEBUG nova.network.neutron [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated VIF entry in instance network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:46:46 user nova-compute[74880]: DEBUG nova.network.neutron [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:46:46 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-80edfddb-75ba-4c99-b96c-44e1d9ff3e73 req-046187ad-fd62-41d1-8bdc-2c71f48852d3 service nova] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:46:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:47 user nova-compute[74880]: INFO nova.compute.manager [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Rebooting instance
Nov 15 01:46:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:46:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:46:47 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG nova.network.neutron [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-3481fde3-6a03-4936-94ef-07e22b4c45b9 req-afa4e7a4-2c5c-48a5-8886-913983902f1e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-unplugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3481fde3-6a03-4936-94ef-07e22b4c45b9 req-afa4e7a4-2c5c-48a5-8886-913983902f1e service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3481fde3-6a03-4936-94ef-07e22b4c45b9 req-afa4e7a4-2c5c-48a5-8886-913983902f1e service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3481fde3-6a03-4936-94ef-07e22b4c45b9 req-afa4e7a4-2c5c-48a5-8886-913983902f1e service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:48 user nova-compute[74880]: DEBUG nova.compute.manager [req-3481fde3-6a03-4936-94ef-07e22b4c45b9 req-afa4e7a4-2c5c-48a5-8886-913983902f1e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-unplugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:46:48 user nova-compute[74880]: WARNING nova.compute.manager [req-3481fde3-6a03-4936-94ef-07e22b4c45b9 req-afa4e7a4-2c5c-48a5-8886-913983902f1e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-unplugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 01:46:49 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance destroyed successfully.
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'resources' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-100836865',display_name='tempest-TestMinimumBasicScenario-server-100836865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-100836865',id=50,image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7zICVAyfv2yj+pQI1k5oLkzplJqKI9CUJgsCvEp5t4Zy43SxujZFTCii/nQQIMjvK1JkROTs1fzPTVMGIzz9K66qiXte2Axn7rWshkMUZ7EIs76p+pkDd1z6mmGDns8A==',key_name='tempest-TestMinimumBasicScenario-606559497',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:44:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-4hjhjwjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:46:48Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=9489a5b9-53a0-4971-8d92-42e8cf43d1d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89dc6cac-4f, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62c696ca-39b6-4e65-9fb9-8cd78a655f9f) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:49 user nova-compute[74880]: INFO os_vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f')
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:46:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8f8fc-2a05-4840-bbaa-d646faf36bda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:46:49 user nova-compute[74880]: No targets found.
Nov 15 01:46:49 user nova-compute[74880]: iSNS:
Nov 15 01:46:49 user nova-compute[74880]: No targets found.
Nov 15 01:46:49 user nova-compute[74880]: STATIC:
Nov 15 01:46:49 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f
Nov 15 01:46:49 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:46:49 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:46:49 user nova-compute[74880]: FIRMWARE:
Nov 15 01:46:49 user nova-compute[74880]: No targets found.
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:46:49 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:46:49 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81ba925-71f2-47ef-9ee3-c2f89384ab1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5dc5fe-8a50-4706-9e41-e45cff87af21]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06ae560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[52102ea3-a60a-49d1-a213-439a84d4ee61]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f4419a-6d39-4ccf-8b3b-3ae2dcad7b08]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1952b9-eb3c-46a9-befc-ae48772258bf]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f3a728-47fb-4d25-8c27-0a21146ad089]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[456fedc9-69c5-46a3-92d0-3c9abc71e10a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6328e1-32b4-436f-af1b-19e478ccb768]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]
Nov 15 01:46:49 user nova-compute[74880]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38d34ce-2a60-4a4e-b218-f28d5fc903ab]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== disconnect_volume: return (303ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Start _get_guest_xml network_info=[{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e80acad4-8a97-4e0d-b0ca-3e144e361ab9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': 'e80acad4-8a97-4e0d-b0ca-3e144e361ab9'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9489a5b9-53a0-4971-8d92-42e8cf43d1d6', 'attached_at': '', 'detached_at': '', 'volume_id': '21208614-0f9c-4621-a38b-32a14656d37f', 'serial': '21208614-0f9c-4621-a38b-32a14656d37f'}, 'mount_device': '/dev/vdb', 'attachment_id': '77ef3ca8-736b-48e3-b9ee-d6076482973d', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:46:49 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:46:49 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e80acad4-8a97-4e0d-b0ca-3e144e361ab9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.objects.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Object Instance<9489a5b9-53a0-4971-8d92-42e8cf43d1d6> lazy-loaded attributes: resources,vcpu_model {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:46:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:46:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:46:49 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e140e4-dad0-4c87-9a52-b61ee9ff28d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:46:49 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b863590b-5114-4921-bb45-44de175f1f6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f] added
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[051b1841-0229-4b0d-884e-3ebe192af3eb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a59ba2-a96c-4677-a52e-006460c482e6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRTyzPNb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRTyzPNb" returned: 0 in 0.025s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa9372-7f4f-4262-aa65-b22e3cab6fd4]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRTyzPNb'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30725fa0-4a78-48ea-ae00-ebc43aba411a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7c3e78-8817-4413-b94b-fded726da19d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:46:49 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:46:49 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:46:49 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 01:46:49 user nova-compute[74880]: 
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899c009-642e-47fc-b254-c653c79a5863]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]
Nov 15 01:46:49 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[017695d3-cef7-4d27-9fba-e4ae5f5a0f50]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc4835d-20db-4290-b060-1e286fa5a204]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:46:49 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0755766-bdde-4b8f-92ba-bc626c27e9eb]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:46:49 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-daf40ca1-65f4-4913-a63b-e2c9475390c4 req-93db75ac-0c95-4c14-b070-8369964a62f7 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-daf40ca1-65f4-4913-a63b-e2c9475390c4 req-93db75ac-0c95-4c14-b070-8369964a62f7 service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-daf40ca1-65f4-4913-a63b-e2c9475390c4 req-93db75ac-0c95-4c14-b070-8369964a62f7 service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-daf40ca1-65f4-4913-a63b-e2c9475390c4 req-93db75ac-0c95-4c14-b070-8369964a62f7 service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.compute.manager [req-daf40ca1-65f4-4913-a63b-e2c9475390c4 req-93db75ac-0c95-4c14-b070-8369964a62f7 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:46:50 user nova-compute[74880]: WARNING nova.compute.manager [req-daf40ca1-65f4-4913-a63b-e2c9475390c4 req-93db75ac-0c95-4c14-b070-8369964a62f7 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 01:46:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26361376631656234', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361376631656234', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-100836865',display_name='tempest-TestMinimumBasicScenario-server-100836865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-100836865',id=50,image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7zICVAyfv2yj+pQI1k5oLkzplJqKI9CUJgsCvEp5t4Zy43SxujZFTCii/nQQIMjvK1JkROTs1fzPTVMGIzz9K66qiXte2Axn7rWshkMUZ7EIs76p+pkDd1z6mmGDns8A==',key_name='tempest-TestMinimumBasicScenario-606559497',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:44:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-4hjhjwjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:46:48Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=9489a5b9-53a0-4971-8d92-42e8cf43d1d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'pci_devices' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.objects.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Object Instance<9489a5b9-53a0-4971-8d92-42e8cf43d1d6> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:46:50 user nova-compute[74880]:   <uuid>9489a5b9-53a0-4971-8d92-42e8cf43d1d6</uuid>
Nov 15 01:46:50 user nova-compute[74880]:   <name>instance-00000032</name>
Nov 15 01:46:50 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:46:50 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:46:50 user nova-compute[74880]:   <metadata>
Nov 15 01:46:50 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:46:50 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:46:50 user nova-compute[74880]:       <nova:name>tempest-TestMinimumBasicScenario-server-100836865</nova:name>
Nov 15 01:46:50 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:46:49</nova:creationTime>
Nov 15 01:46:50 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:46:50 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:46:50 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:46:50 user nova-compute[74880]:       <nova:owner>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:user uuid="7dc61549e25c4d10b9b8bd0422bdba76">tempest-TestMinimumBasicScenario-2025011480-project-member</nova:user>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:project uuid="548b186a8faa471ab7e009fbe3432923">tempest-TestMinimumBasicScenario-2025011480</nova:project>
Nov 15 01:46:50 user nova-compute[74880]:       </nova:owner>
Nov 15 01:46:50 user nova-compute[74880]:       <nova:root type="image" uuid="e80acad4-8a97-4e0d-b0ca-3e144e361ab9"/>
Nov 15 01:46:50 user nova-compute[74880]:       <nova:ports>
Nov 15 01:46:50 user nova-compute[74880]:         <nova:port uuid="89dc6cac-4f73-4331-92a6-9c8771504199">
Nov 15 01:46:50 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 01:46:50 user nova-compute[74880]:         </nova:port>
Nov 15 01:46:50 user nova-compute[74880]:       </nova:ports>
Nov 15 01:46:50 user nova-compute[74880]:     </nova:instance>
Nov 15 01:46:50 user nova-compute[74880]:   </metadata>
Nov 15 01:46:50 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:46:50 user nova-compute[74880]:     <system>
Nov 15 01:46:50 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:46:50 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:46:50 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:46:50 user nova-compute[74880]:       <entry name="serial">9489a5b9-53a0-4971-8d92-42e8cf43d1d6</entry>
Nov 15 01:46:50 user nova-compute[74880]:       <entry name="uuid">9489a5b9-53a0-4971-8d92-42e8cf43d1d6</entry>
Nov 15 01:46:50 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:46:50 user nova-compute[74880]:     </system>
Nov 15 01:46:50 user nova-compute[74880]:   </sysinfo>
Nov 15 01:46:50 user nova-compute[74880]:   <os>
Nov 15 01:46:50 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:46:50 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:46:50 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:46:50 user nova-compute[74880]:   </os>
Nov 15 01:46:50 user nova-compute[74880]:   <features>
Nov 15 01:46:50 user nova-compute[74880]:     <acpi/>
Nov 15 01:46:50 user nova-compute[74880]:     <apic/>
Nov 15 01:46:50 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:46:50 user nova-compute[74880]:   </features>
Nov 15 01:46:50 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:46:50 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:46:50 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:46:50 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:46:50 user nova-compute[74880]:   </clock>
Nov 15 01:46:50 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:46:50 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:46:50 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:46:50 user nova-compute[74880]:   </cpu>
Nov 15 01:46:50 user nova-compute[74880]:   <devices>
Nov 15 01:46:50 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:46:50 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:46:50 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk"/>
Nov 15 01:46:50 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:46:50 user nova-compute[74880]:     </disk>
Nov 15 01:46:50 user nova-compute[74880]:     <disk type="block" device="disk">
Nov 15 01:46:50 user nova-compute[74880]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:46:50 user nova-compute[74880]:       <source dev="/dev/sdb"/>
Nov 15 01:46:50 user nova-compute[74880]:       <target dev="vdb" bus="virtio"/>
Nov 15 01:46:50 user nova-compute[74880]:       <serial>21208614-0f9c-4621-a38b-32a14656d37f</serial>
Nov 15 01:46:50 user nova-compute[74880]:     </disk>
Nov 15 01:46:50 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:46:50 user nova-compute[74880]:       <mac address="fa:16:3e:34:b4:10"/>
Nov 15 01:46:50 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:46:50 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:46:50 user nova-compute[74880]:       <target dev="tap89dc6cac-4f"/>
Nov 15 01:46:50 user nova-compute[74880]:     </interface>
Nov 15 01:46:50 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:46:50 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/console.log" append="off"/>
Nov 15 01:46:50 user nova-compute[74880]:     </serial>
Nov 15 01:46:50 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:46:50 user nova-compute[74880]:     <video>
Nov 15 01:46:50 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:46:50 user nova-compute[74880]:     </video>
Nov 15 01:46:50 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:46:50 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:46:50 user nova-compute[74880]:     </rng>
Nov 15 01:46:50 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:46:50 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:46:50 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:46:50 user nova-compute[74880]:     </memballoon>
Nov 15 01:46:50 user nova-compute[74880]:   </devices>
Nov 15 01:46:50 user nova-compute[74880]: </domain>
Nov 15 01:46:50 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:46:50 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.objects.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Object Instance<9489a5b9-53a0-4971-8d92-42e8cf43d1d6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Cannot resize image /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'migration_context' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.objects.base [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Object Instance<9489a5b9-53a0-4971-8d92-42e8cf43d1d6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74880) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-100836865',display_name='tempest-TestMinimumBasicScenario-server-100836865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-100836865',id=50,image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7zICVAyfv2yj+pQI1k5oLkzplJqKI9CUJgsCvEp5t4Zy43SxujZFTCii/nQQIMjvK1JkROTs1fzPTVMGIzz9K66qiXte2Axn7rWshkMUZ7EIs76p+pkDd1z6mmGDns8A==',key_name='tempest-TestMinimumBasicScenario-606559497',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:44:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-4hjhjwjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:46:48Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=9489a5b9-53a0-4971-8d92-42e8cf43d1d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG os_vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aa2fce4-428e-570a-9076-78576bc85814', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89dc6cac-4f, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89dc6cac-4f, col_values=(('qos', UUID('53cbe809-ff0f-457c-80d0-70b8f93b545c')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89dc6cac-4f, col_values=(('external_ids', {'iface-id': '89dc6cac-4f73-4331-92a6-9c8771504199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:b4:10', 'vm-uuid': '9489a5b9-53a0-4971-8d92-42e8cf43d1d6'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:46:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:51 user nova-compute[74880]: INFO os_vif [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f')
Nov 15 01:46:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-620c1e59-b2fd-492c-b826-4e3e427c5ad3 req-2ad97aa5-4079-4746-a4be-06a0dbf20487 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-620c1e59-b2fd-492c-b826-4e3e427c5ad3 req-2ad97aa5-4079-4746-a4be-06a0dbf20487 service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-620c1e59-b2fd-492c-b826-4e3e427c5ad3 req-2ad97aa5-4079-4746-a4be-06a0dbf20487 service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-620c1e59-b2fd-492c-b826-4e3e427c5ad3 req-2ad97aa5-4079-4746-a4be-06a0dbf20487 service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG nova.compute.manager [req-620c1e59-b2fd-492c-b826-4e3e427c5ad3 req-2ad97aa5-4079-4746-a4be-06a0dbf20487 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:46:53 user nova-compute[74880]: WARNING nova.compute.manager [req-620c1e59-b2fd-492c-b826-4e3e427c5ad3 req-2ad97aa5-4079-4746-a4be-06a0dbf20487 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 01:46:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:46:55 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance rebooted successfully.
Nov 15 01:46:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:46:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-e793a899-230f-4587-8894-a013b21d15f4 req-8d90e9d4-ddde-47a1-8c61-c56c7b036ef9 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:46:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e793a899-230f-4587-8894-a013b21d15f4 req-8d90e9d4-ddde-47a1-8c61-c56c7b036ef9 service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:46:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e793a899-230f-4587-8894-a013b21d15f4 req-8d90e9d4-ddde-47a1-8c61-c56c7b036ef9 service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:46:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-e793a899-230f-4587-8894-a013b21d15f4 req-8d90e9d4-ddde-47a1-8c61-c56c7b036ef9 service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:55 user nova-compute[74880]: DEBUG nova.compute.manager [req-e793a899-230f-4587-8894-a013b21d15f4 req-8d90e9d4-ddde-47a1-8c61-c56c7b036ef9 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:46:55 user nova-compute[74880]: WARNING nova.compute.manager [req-e793a899-230f-4587-8894-a013b21d15f4 req-8d90e9d4-ddde-47a1-8c61-c56c7b036ef9 service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 01:46:55 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7c2157e4-ccfe-4a2d-8ffc-cd278a222cd4 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.434s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:46:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:46:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:06 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:47:07 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:47:08 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:47:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:47:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.213829040527344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:47:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:47:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:47:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:47:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:47:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:47:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:47:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:47:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:47:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:48:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:48:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:48:10 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:48:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:48:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.203330993652344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:48:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:48:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:48:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:48:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:48:39 user nova-compute[74880]: DEBUG nova.compute.manager [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing instance network info cache due to event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:48:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:48:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:48:39 user nova-compute[74880]: DEBUG nova.network.neutron [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated VIF entry in instance network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5cab4e1c-d053-4cc2-80ab-adc14d6b9aa3 req-53b9a40e-7a22-47f7-9660-2119b378e89f service nova] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing instance network info cache due to event network-changed-89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Refreshing network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:48:40 user nova-compute[74880]: INFO nova.compute.manager [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Detaching volume 21208614-0f9c-4621-a38b-32a14656d37f
Nov 15 01:48:40 user nova-compute[74880]: INFO nova.virt.block_device [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Attempting to driver detach volume 21208614-0f9c-4621-a38b-32a14656d37f from mountpoint /dev/vdb
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Attempting to detach device vdb from instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:48:40 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:48:40 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:48:40 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:48:40 user nova-compute[74880]:   <serial>21208614-0f9c-4621-a38b-32a14656d37f</serial>
Nov 15 01:48:40 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:48:40 user nova-compute[74880]: </disk>
Nov 15 01:48:40 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:48:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully detached device vdb from instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 from the persistent domain config.
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:48:40 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:48:40 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:48:40 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:48:40 user nova-compute[74880]:   <serial>21208614-0f9c-4621-a38b-32a14656d37f</serial>
Nov 15 01:48:40 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 01:48:40 user nova-compute[74880]: </disk>
Nov 15 01:48:40 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated VIF entry in instance network info cache for port 89dc6cac-4f73-4331-92a6-9c8771504199. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG nova.network.neutron [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:48:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-95927bef-0a14-4fbe-a723-62d0498eff5c req-a4c9a796-0f8e-4a0c-a91e-a9179a79823a service nova] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:48:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:48:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:48:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:01 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 is timed out.
Nov 15 01:49:01 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully detached device vdb from instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 from the live domain config.
Nov 15 01:49:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRTyzPNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:49:01 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed698d5-97f6-499f-8226-0b3bb581fb60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:49:01 user nova-compute[74880]: No targets found.
Nov 15 01:49:01 user nova-compute[74880]: iSNS:
Nov 15 01:49:01 user nova-compute[74880]: No targets found.
Nov 15 01:49:01 user nova-compute[74880]: STATIC:
Nov 15 01:49:01 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f
Nov 15 01:49:01 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:49:01 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:49:01 user nova-compute[74880]: FIRMWARE:
Nov 15 01:49:01 user nova-compute[74880]: No targets found.
Nov 15 01:49:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:49:01 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:49:01 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5425a9f-3096-44da-ac3f-7d669dc374e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f384d4-f720-4662-9afa-2bb9b9b38813]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:49:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f (non-flash)
Nov 15 01:49:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d05c97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e9d049-f9be-4c13-91b2-2c9456dada51]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b52683-0958-426d-ba7a-5b5c1567bc75]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[834426cc-2702-4b9d-98d1-8586e716bc32]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ed9fa-7044-47e6-8577-6a8af1a9080d]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fbfbb4-bb28-4cbc-a861-8dbe0f3f751c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[732140bb-bac8-4b92-b13a-cf95d32a92ea]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260]
Nov 15 01:49:01 user nova-compute[74880]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f, portal: 172.16.0.220,3260] successful.
Nov 15 01:49:01 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21208614-0f9c-4621-a38b-32a14656d37f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ee412-5b62-4eeb-886a-3ddad3576e5c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== disconnect_volume: return (315ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:02 user nova-compute[74880]: DEBUG nova.objects.instance [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'flavor' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:49:02 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-bf7434b9-f7cc-4adf-a5d2-428f229a1b0b tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.622s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:03 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:49:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [{"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-9489a5b9-53a0-4971-8d92-42e8cf43d1d6" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:49:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.20248031616211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:49:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:49:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:49:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Verify base images {{(pid=74880) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Image id e80acad4-8a97-4e0d-b0ca-3e144e361ab9 yields fingerprint 08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 {{(pid=74880) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] image e80acad4-8a97-4e0d-b0ca-3e144e361ab9 at (/opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92): checking
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] image e80acad4-8a97-4e0d-b0ca-3e144e361ab9 at (/opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92): image is in use {{(pid=74880) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74880) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 is a valid instance name {{(pid=74880) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 has a disk file {{(pid=74880) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 is backed by 08c31c1ac2ca82da47c97f4493d8360f4b3b6f92 {{(pid=74880) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3
Nov 15 01:49:30 user nova-compute[74880]: WARNING nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Active base files: /opt/stack/data/nova/instances/_base/08c31c1ac2ca82da47c97f4493d8360f4b3b6f92
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Removable base files: /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55 /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1 /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3 /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11cf285a8523999d99b8182b419ab605e7052b0b
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/75a326e8e173f6cb9a0ef08059a2143dd164ae55
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0b7eb0dca3d9de129004cf3270dd66ee0e263e1
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4af5310b53f2e5f20c2481b26a738874b8a5eccf
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27afb3fffe8aa274cb87e32153030da69370829e
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/545cbd6338b38b801e89bf5065abc89cd8de72c3
Nov 15 01:49:30 user nova-compute[74880]: INFO nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a8d6848dcb6e056e8caf8503973a712bfe46cf77
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Verification complete {{(pid=74880) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Verify swap images {{(pid=74880) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 01:49:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.imagecache [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Verify ephemeral images {{(pid=74880) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 01:49:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:33 user nova-compute[74880]: INFO nova.compute.manager [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Terminating instance
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.compute.manager [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-8f6358a8-2249-4d5a-b665-d48974d0ecc6 req-7adb6113-e426-40ba-9932-3c447521060e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-unplugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8f6358a8-2249-4d5a-b665-d48974d0ecc6 req-7adb6113-e426-40ba-9932-3c447521060e service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8f6358a8-2249-4d5a-b665-d48974d0ecc6 req-7adb6113-e426-40ba-9932-3c447521060e service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-8f6358a8-2249-4d5a-b665-d48974d0ecc6 req-7adb6113-e426-40ba-9932-3c447521060e service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-8f6358a8-2249-4d5a-b665-d48974d0ecc6 req-7adb6113-e426-40ba-9932-3c447521060e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-unplugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.compute.manager [req-8f6358a8-2249-4d5a-b665-d48974d0ecc6 req-7adb6113-e426-40ba-9932-3c447521060e service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-unplugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Instance destroyed successfully.
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'resources' on Instance uuid 9489a5b9-53a0-4971-8d92-42e8cf43d1d6 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-100836865',display_name='tempest-TestMinimumBasicScenario-server-100836865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-100836865',id=50,image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7zICVAyfv2yj+pQI1k5oLkzplJqKI9CUJgsCvEp5t4Zy43SxujZFTCii/nQQIMjvK1JkROTs1fzPTVMGIzz9K66qiXte2Axn7rWshkMUZ7EIs76p+pkDd1z6mmGDns8A==',key_name='tempest-TestMinimumBasicScenario-606559497',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:44:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-4hjhjwjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e80acad4-8a97-4e0d-b0ca-3e144e361ab9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:46:55Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=9489a5b9-53a0-4971-8d92-42e8cf43d1d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "89dc6cac-4f73-4331-92a6-9c8771504199", "address": "fa:16:3e:34:b4:10", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc6cac-4f", "ovs_interfaceid": "89dc6cac-4f73-4331-92a6-9c8771504199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG os_vif [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89dc6cac-4f, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53cbe809-ff0f-457c-80d0-70b8f93b545c) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:33 user nova-compute[74880]: INFO os_vif [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=89dc6cac-4f73-4331-92a6-9c8771504199,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc6cac-4f')
Nov 15 01:49:33 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Deleting instance files /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6_del
Nov 15 01:49:33 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Deletion of /opt/stack/data/nova/instances/9489a5b9-53a0-4971-8d92-42e8cf43d1d6_del complete
Nov 15 01:49:34 user nova-compute[74880]: INFO nova.compute.manager [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 01:49:34 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:49:34 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Took 0.48 seconds to deallocate network for instance.
Nov 15 01:49:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:49:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:34 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Deleted allocations for instance 9489a5b9-53a0-4971-8d92-42e8cf43d1d6
Nov 15 01:49:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7a8d3a0c-3199-4e70-83b5-08c1a7b66a1f tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.635s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:49:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] Acquiring lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:49:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:49:35 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] Lock "9489a5b9-53a0-4971-8d92-42e8cf43d1d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:49:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] No waiting events found dispatching network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:49:35 user nova-compute[74880]: WARNING nova.compute.manager [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received unexpected event network-vif-plugged-89dc6cac-4f73-4331-92a6-9c8771504199 for instance with vm_state deleted and task_state None.
Nov 15 01:49:35 user nova-compute[74880]: DEBUG nova.compute.manager [req-2c59471a-d3b8-4e00-a36d-cad69693c664 req-ecc9bb74-736f-4b03-a8ec-3bef251cc88d service nova] [instance: 9489a5b9-53a0-4971-8d92-42e8cf43d1d6] Received event network-vif-deleted-89dc6cac-4f73-4331-92a6-9c8771504199 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:49:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:49:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:49:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:49:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:49:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:50:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:50:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:50:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:05 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:10 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:50:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:50:11 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9138MB free_disk=25.229812622070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:50:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:50:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:50:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:50:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:50:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:50:27 user nova-compute[74880]: INFO nova.compute.claims [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Claim successful on node user
Nov 15 01:50:27 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:50:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:50:28 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.policy [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc61549e25c4d10b9b8bd0422bdba76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b186a8faa471ab7e009fbe3432923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:50:28 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Creating image(s)
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "/opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "/opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "/opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "f97832831fdc00b2e398da7eeaaee7cf8529f0a7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "f97832831fdc00b2e398da7eeaaee7cf8529f0a7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.part --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG nova.virt.images [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] 2ed2bdd0-f03a-4bb5-9fd5-246681decca0 was qcow2, converting to raw {{(pid=74880) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG nova.privsep.utils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74880) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.part /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.converted {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Successfully created port: 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.part /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.converted" returned: 0 in 0.630s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.converted --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "f97832831fdc00b2e398da7eeaaee7cf8529f0a7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.618s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Successfully updated port: 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "f97832831fdc00b2e398da7eeaaee7cf8529f0a7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "f97832831fdc00b2e398da7eeaaee7cf8529f0a7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing instance network info cache due to event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7 --force-share --output=json" returned: 0 in 0.196s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7,backing_fmt=raw /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7,backing_fmt=raw /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk 1073741824" returned: 0 in 0.064s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "f97832831fdc00b2e398da7eeaaee7cf8529f0a7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance network_info: |[{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f97832831fdc00b2e398da7eeaaee7cf8529f0a7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Cannot resize image /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Ensure instance console log exists: /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Start _get_guest_xml network_info=[{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:50:25Z,direct_url=<?>,disk_format='qcow2',id=2ed2bdd0-f03a-4bb5-9fd5-246681decca0,min_disk=0,min_ram=0,name='tempest-scenario-img--299950240',owner='548b186a8faa471ab7e009fbe3432923',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:50:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '2ed2bdd0-f03a-4bb5-9fd5-246681decca0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:50:30 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:50:30 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:50:25Z,direct_url=<?>,disk_format='qcow2',id=2ed2bdd0-f03a-4bb5-9fd5-246681decca0,min_disk=0,min_ram=0,name='tempest-scenario-img--299950240',owner='548b186a8faa471ab7e009fbe3432923',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:50:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-219238462',display_name='tempest-TestMinimumBasicScenario-server-219238462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-219238462',id=51,image_ref='2ed2bdd0-f03a-4bb5-9fd5-246681decca0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcVsU1oW/yptECmYhB+g6WH0qSCETVx35uJUfSw0mOVCvT78stm3VH+lfTdiv8j4ihD8T8PVX+3SnMgbaQif5cX8j3oP7CZpJly2Hd94+O6Xa0RnERq/fDtZ9Rw4zyN6w==',key_name='tempest-TestMinimumBasicScenario-2062377927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-k9nuyo5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ed2bdd0-f03a-4bb5-9fd5-246681decca0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:50:28Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=58807500-152d-4a4f-b8fe-1c757f914d0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.objects.instance [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'pci_devices' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:50:30 user nova-compute[74880]:   <uuid>58807500-152d-4a4f-b8fe-1c757f914d0d</uuid>
Nov 15 01:50:30 user nova-compute[74880]:   <name>instance-00000033</name>
Nov 15 01:50:30 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:50:30 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:50:30 user nova-compute[74880]:   <metadata>
Nov 15 01:50:30 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:50:30 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:50:30 user nova-compute[74880]:       <nova:name>tempest-TestMinimumBasicScenario-server-219238462</nova:name>
Nov 15 01:50:30 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:50:30</nova:creationTime>
Nov 15 01:50:30 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:50:30 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:50:30 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:50:30 user nova-compute[74880]:       <nova:owner>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:user uuid="7dc61549e25c4d10b9b8bd0422bdba76">tempest-TestMinimumBasicScenario-2025011480-project-member</nova:user>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:project uuid="548b186a8faa471ab7e009fbe3432923">tempest-TestMinimumBasicScenario-2025011480</nova:project>
Nov 15 01:50:30 user nova-compute[74880]:       </nova:owner>
Nov 15 01:50:30 user nova-compute[74880]:       <nova:root type="image" uuid="2ed2bdd0-f03a-4bb5-9fd5-246681decca0"/>
Nov 15 01:50:30 user nova-compute[74880]:       <nova:ports>
Nov 15 01:50:30 user nova-compute[74880]:         <nova:port uuid="93db99b9-7656-4e5c-a328-91f861ba00cc">
Nov 15 01:50:30 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 01:50:30 user nova-compute[74880]:         </nova:port>
Nov 15 01:50:30 user nova-compute[74880]:       </nova:ports>
Nov 15 01:50:30 user nova-compute[74880]:     </nova:instance>
Nov 15 01:50:30 user nova-compute[74880]:   </metadata>
Nov 15 01:50:30 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:50:30 user nova-compute[74880]:     <system>
Nov 15 01:50:30 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:50:30 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:50:30 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:50:30 user nova-compute[74880]:       <entry name="serial">58807500-152d-4a4f-b8fe-1c757f914d0d</entry>
Nov 15 01:50:30 user nova-compute[74880]:       <entry name="uuid">58807500-152d-4a4f-b8fe-1c757f914d0d</entry>
Nov 15 01:50:30 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:50:30 user nova-compute[74880]:     </system>
Nov 15 01:50:30 user nova-compute[74880]:   </sysinfo>
Nov 15 01:50:30 user nova-compute[74880]:   <os>
Nov 15 01:50:30 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:50:30 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:50:30 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:50:30 user nova-compute[74880]:   </os>
Nov 15 01:50:30 user nova-compute[74880]:   <features>
Nov 15 01:50:30 user nova-compute[74880]:     <acpi/>
Nov 15 01:50:30 user nova-compute[74880]:     <apic/>
Nov 15 01:50:30 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:50:30 user nova-compute[74880]:   </features>
Nov 15 01:50:30 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:50:30 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:50:30 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:50:30 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:50:30 user nova-compute[74880]:   </clock>
Nov 15 01:50:30 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:50:30 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:50:30 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:50:30 user nova-compute[74880]:   </cpu>
Nov 15 01:50:30 user nova-compute[74880]:   <devices>
Nov 15 01:50:30 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:50:30 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:50:30 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk"/>
Nov 15 01:50:30 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:50:30 user nova-compute[74880]:     </disk>
Nov 15 01:50:30 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:50:30 user nova-compute[74880]:       <mac address="fa:16:3e:bf:c0:b0"/>
Nov 15 01:50:30 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:50:30 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:50:30 user nova-compute[74880]:       <target dev="tap93db99b9-76"/>
Nov 15 01:50:30 user nova-compute[74880]:     </interface>
Nov 15 01:50:30 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:50:30 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/console.log" append="off"/>
Nov 15 01:50:30 user nova-compute[74880]:     </serial>
Nov 15 01:50:30 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:50:30 user nova-compute[74880]:     <video>
Nov 15 01:50:30 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:50:30 user nova-compute[74880]:     </video>
Nov 15 01:50:30 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:50:30 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:50:30 user nova-compute[74880]:     </rng>
Nov 15 01:50:30 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:50:30 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:50:30 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:50:30 user nova-compute[74880]:     </memballoon>
Nov 15 01:50:30 user nova-compute[74880]:   </devices>
Nov 15 01:50:30 user nova-compute[74880]: </domain>
Nov 15 01:50:30 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-219238462',display_name='tempest-TestMinimumBasicScenario-server-219238462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-219238462',id=51,image_ref='2ed2bdd0-f03a-4bb5-9fd5-246681decca0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcVsU1oW/yptECmYhB+g6WH0qSCETVx35uJUfSw0mOVCvT78stm3VH+lfTdiv8j4ihD8T8PVX+3SnMgbaQif5cX8j3oP7CZpJly2Hd94+O6Xa0RnERq/fDtZ9Rw4zyN6w==',key_name='tempest-TestMinimumBasicScenario-2062377927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-k9nuyo5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ed2bdd0-f03a-4bb5-9fd5-246681decca0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:50:28Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=58807500-152d-4a4f-b8fe-1c757f914d0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG os_vif [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a710cda-5941-503e-924d-cfbb43b12d62', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93db99b9-76, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93db99b9-76, col_values=(('qos', UUID('3f09963b-70d4-440d-b630-01167343ebd5')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93db99b9-76, col_values=(('external_ids', {'iface-id': '93db99b9-7656-4e5c-a328-91f861ba00cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c0:b0', 'vm-uuid': '58807500-152d-4a4f-b8fe-1c757f914d0d'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:30 user nova-compute[74880]: INFO os_vif [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76')
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No VIF found with MAC fa:16:3e:bf:c0:b0, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated VIF entry in instance network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG nova.network.neutron [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:50:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-08d09c07-3f70-477e-8f2a-944c88ced000 req-87b23421-1c21-47ac-b71e-345ee2719349 service nova] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-87246cd7-2ff3-4f9f-afd0-1352287794db req-d4318a08-b19d-4b13-8006-1091253a2c25 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87246cd7-2ff3-4f9f-afd0-1352287794db req-d4318a08-b19d-4b13-8006-1091253a2c25 service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87246cd7-2ff3-4f9f-afd0-1352287794db req-d4318a08-b19d-4b13-8006-1091253a2c25 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-87246cd7-2ff3-4f9f-afd0-1352287794db req-d4318a08-b19d-4b13-8006-1091253a2c25 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-87246cd7-2ff3-4f9f-afd0-1352287794db req-d4318a08-b19d-4b13-8006-1091253a2c25 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:50:32 user nova-compute[74880]: WARNING nova.compute.manager [req-87246cd7-2ff3-4f9f-afd0-1352287794db req-d4318a08-b19d-4b13-8006-1091253a2c25 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state building and task_state spawning.
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:50:34 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance spawned successfully.
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:50:34 user nova-compute[74880]: INFO nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-d36b387e-1c00-4d76-959f-35c7b6b2c59c req-b835ec85-c2b1-4cbf-840a-c82f0774affa service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d36b387e-1c00-4d76-959f-35c7b6b2c59c req-b835ec85-c2b1-4cbf-840a-c82f0774affa service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d36b387e-1c00-4d76-959f-35c7b6b2c59c req-b835ec85-c2b1-4cbf-840a-c82f0774affa service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d36b387e-1c00-4d76-959f-35c7b6b2c59c req-b835ec85-c2b1-4cbf-840a-c82f0774affa service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-d36b387e-1c00-4d76-959f-35c7b6b2c59c req-b835ec85-c2b1-4cbf-840a-c82f0774affa service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:50:34 user nova-compute[74880]: WARNING nova.compute.manager [req-d36b387e-1c00-4d76-959f-35c7b6b2c59c req-b835ec85-c2b1-4cbf-840a-c82f0774affa service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state building and task_state spawning.
Nov 15 01:50:34 user nova-compute[74880]: INFO nova.compute.manager [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Took 6.75 seconds to build instance.
Nov 15 01:50:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-fcf35176-59d1-40cc-9ba0-d817449d223a tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.848s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:50:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Triggering sync for uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 01:50:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:50:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:50:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:50:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:50:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:50:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:50:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:50:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:50:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:51:10 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:51:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:51:12 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:51:12 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.179393768310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 58807500-152d-4a4f-b8fe-1c757f914d0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:51:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:51:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:51:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:51:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:51:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:51:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:51:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:51:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:51:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:51:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:51:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:51:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:51:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:51:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:51:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:51:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:52:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:52:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:52:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:52:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:07 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:52:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:52:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:52:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:52:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:12 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:52:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:52:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.178791046142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 58807500-152d-4a4f-b8fe-1c757f914d0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:52:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:52:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'flavor' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:21 user nova-compute[74880]: INFO nova.compute.manager [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Attaching volume eb41669c-6b72-4598-83a5-922664a2170a to /dev/vdb
Nov 15 01:52:21 user nova-compute[74880]: DEBUG os_brick.utils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe9865-c194-4d9d-8b58-252d186a6387]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.057s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8fb2b7-40ec-4c41-8ad2-9bf2ef0a774d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcba34f6-46b8-4c14-a16f-c2e7ce66def9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[215c36ea-d9fd-4aac-a829-e8801177e59a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:52:21 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:52:21 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08438a-845a-47b9-94ba-acf04d7d57eb]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG os_brick.utils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:52:21 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating existing volume attachment record: 462a5a0d-b854-4636-a99f-6e6403d5eee5 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBcohZWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:52:25 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:52:25 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:52:25 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c073d92d-ea35-4f6a-9608-65fe7a733eb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:52:25 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a096a9-09db-4ca1-b643-cd952a917160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a] added
Nov 15 01:52:25 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.061s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28328dde-17b3-45c3-b5b1-d67662aec991]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8b918b-9990-4dfd-a6f1-72983668ee5a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBcohZWQ {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBcohZWQ" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a97924-6da3-45a4-b803-c2196501425f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBcohZWQ'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d8afa-c003-405f-bdae-72feb6fa6d3a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f89f70-f32c-4715-9c09-1dedf508b431]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:52:26 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:52:26 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:52:26 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 01:52:26 user nova-compute[74880]: 
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607f123-fe32-4d07-898e-2a1ef8febe38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260]
Nov 15 01:52:26 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260] successful.
Nov 15 01:52:26 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b311db3a-7140-43cb-afcf-f8a4b6c93579]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7140e5-1ded-4f03-9670-12f67463b555]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a (non-flash)
Nov 15 01:52:26 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a (non-flash)
Nov 15 01:52:26 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3398424b-294f-44de-ae42-5f1873890553]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:52:26 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBcohZWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26130626334353434', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130626334353434', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'flavor' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:52:27 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:52:27 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:52:27 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:52:27 user nova-compute[74880]:   <serial>eb41669c-6b72-4598-83a5-922664a2170a</serial>
Nov 15 01:52:27 user nova-compute[74880]: </disk>
Nov 15 01:52:27 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] No VIF found with MAC fa:16:3e:bf:c0:b0, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:52:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2b29e281-8cdf-4011-b285-32a5bd81f51e tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.495s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG nova.compute.manager [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing instance network info cache due to event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG nova.network.neutron [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:52:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:31 user nova-compute[74880]: DEBUG nova.network.neutron [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated VIF entry in instance network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:52:31 user nova-compute[74880]: DEBUG nova.network.neutron [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:52:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-602efb07-2d60-4fbf-b995-aaef1e18d2c3 req-2b9644a3-8369-4f49-b858-6f947b6816d4 service nova] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:52:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:52:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing instance network info cache due to event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:52:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:52:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:52:32 user nova-compute[74880]: DEBUG nova.network.neutron [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:52:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:33 user nova-compute[74880]: INFO nova.compute.manager [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Rebooting instance
Nov 15 01:52:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated VIF entry in instance network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-5630899f-894a-4900-add1-dbfdcb3c4116 req-5c8d5829-de3c-479c-89ec-8cd6d816c1d8 service nova] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG nova.network.neutron [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:52:33 user nova-compute[74880]: DEBUG nova.compute.manager [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:52:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-12acaa9f-bb47-43ca-bd70-7b8ec0b50504 req-58a7affa-b7b5-41b6-82c4-36343eb1638f service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-unplugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:52:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-12acaa9f-bb47-43ca-bd70-7b8ec0b50504 req-58a7affa-b7b5-41b6-82c4-36343eb1638f service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-12acaa9f-bb47-43ca-bd70-7b8ec0b50504 req-58a7affa-b7b5-41b6-82c4-36343eb1638f service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-12acaa9f-bb47-43ca-bd70-7b8ec0b50504 req-58a7affa-b7b5-41b6-82c4-36343eb1638f service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-12acaa9f-bb47-43ca-bd70-7b8ec0b50504 req-58a7affa-b7b5-41b6-82c4-36343eb1638f service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-unplugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:52:36 user nova-compute[74880]: WARNING nova.compute.manager [req-12acaa9f-bb47-43ca-bd70-7b8ec0b50504 req-58a7affa-b7b5-41b6-82c4-36343eb1638f service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-unplugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state active and task_state reboot_started.
Nov 15 01:52:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance shutdown successfully.
Nov 15 01:52:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-d164a5f5-8f85-42f4-a4a1-501c5ab6de59 req-107b661a-2b70-4e6a-9703-8a495304fc18 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d164a5f5-8f85-42f4-a4a1-501c5ab6de59 req-107b661a-2b70-4e6a-9703-8a495304fc18 service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d164a5f5-8f85-42f4-a4a1-501c5ab6de59 req-107b661a-2b70-4e6a-9703-8a495304fc18 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d164a5f5-8f85-42f4-a4a1-501c5ab6de59 req-107b661a-2b70-4e6a-9703-8a495304fc18 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG nova.compute.manager [req-d164a5f5-8f85-42f4-a4a1-501c5ab6de59 req-107b661a-2b70-4e6a-9703-8a495304fc18 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:52:38 user nova-compute[74880]: WARNING nova.compute.manager [req-d164a5f5-8f85-42f4-a4a1-501c5ab6de59 req-107b661a-2b70-4e6a-9703-8a495304fc18 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state active and task_state reboot_started.
Nov 15 01:52:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance running successfully.
Nov 15 01:52:40 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance soft rebooted successfully.
Nov 15 01:52:40 user nova-compute[74880]: DEBUG nova.compute.manager [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-de1cd149-4326-47ae-b7f6-d2c733f9ceb6 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.173s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:52:40 user nova-compute[74880]: WARNING nova.compute.manager [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state active and task_state None.
Nov 15 01:52:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:52:40 user nova-compute[74880]: DEBUG nova.compute.manager [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:52:40 user nova-compute[74880]: WARNING nova.compute.manager [req-cd426c02-ff21-486d-b0ff-ed38f5cd8d2c req-871b069e-f610-44b5-91d3-523ce6b4e578 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state active and task_state None.
Nov 15 01:52:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:52:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:08 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:53:11 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:53:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:53:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:53:13 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.17675018310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 58807500-152d-4a4f-b8fe-1c757f914d0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:53:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:53:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:53:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:53:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:53:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:53:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:53:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:53:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:53:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:53:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:53:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:53:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:53:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:53:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:53:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:54:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:54:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:54:10 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:54:13 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74880) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 01:54:15 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:54:15 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=25.176193237304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 58807500-152d-4a4f-b8fe-1c757f914d0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:20 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:54:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:54:24 user nova-compute[74880]: DEBUG nova.compute.manager [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing instance network info cache due to event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:54:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:54:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:54:24 user nova-compute[74880]: DEBUG nova.network.neutron [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.network.neutron [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated VIF entry in instance network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.network.neutron [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d39d1699-17a1-45ef-882d-fa1a4e99d69c req-696b2161-1039-46be-8e5a-e368ef9129d9 service nova] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing instance network info cache due to event network-changed-93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.network.neutron [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Refreshing network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:54:25 user nova-compute[74880]: INFO nova.compute.manager [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Detaching volume eb41669c-6b72-4598-83a5-922664a2170a
Nov 15 01:54:25 user nova-compute[74880]: INFO nova.virt.block_device [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Attempting to driver detach volume eb41669c-6b72-4598-83a5-922664a2170a from mountpoint /dev/vdb
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Attempting to detach device vdb from instance 58807500-152d-4a4f-b8fe-1c757f914d0d from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:54:25 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:54:25 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:54:25 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:54:25 user nova-compute[74880]:   <serial>eb41669c-6b72-4598-83a5-922664a2170a</serial>
Nov 15 01:54:25 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:54:25 user nova-compute[74880]: </disk>
Nov 15 01:54:25 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:54:25 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully detached device vdb from instance 58807500-152d-4a4f-b8fe-1c757f914d0d from the persistent domain config.
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58807500-152d-4a4f-b8fe-1c757f914d0d from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:54:25 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:54:25 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:54:25 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:54:25 user nova-compute[74880]:   <serial>eb41669c-6b72-4598-83a5-922664a2170a</serial>
Nov 15 01:54:25 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:54:25 user nova-compute[74880]: </disk>
Nov 15 01:54:25 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.network.neutron [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated VIF entry in instance network info cache for port 93db99b9-7656-4e5c-a328-91f861ba00cc. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG nova.network.neutron [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9cb931f6-1c01-4db0-a0c2-c77055b90aaa req-4febabdd-1c6f-41a1-be32-1da5dcd1de39 service nova] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:54:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:54:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:30 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:54:35 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:54:40 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:45 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:54:46 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58807500-152d-4a4f-b8fe-1c757f914d0d is timed out.
Nov 15 01:54:46 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully detached device vdb from instance 58807500-152d-4a4f-b8fe-1c757f914d0d from the live domain config.
Nov 15 01:54:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBcohZWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:54:46 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b16c1-c81d-4887-8fa0-20cc6d461489]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:54:46 user nova-compute[74880]: No targets found.
Nov 15 01:54:46 user nova-compute[74880]: iSNS:
Nov 15 01:54:46 user nova-compute[74880]: No targets found.
Nov 15 01:54:46 user nova-compute[74880]: STATIC:
Nov 15 01:54:46 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a
Nov 15 01:54:46 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:54:46 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:54:46 user nova-compute[74880]: FIRMWARE:
Nov 15 01:54:46 user nova-compute[74880]: No targets found.
Nov 15 01:54:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:54:46 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:54:46 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[192e5611-8d4b-421a-a3fa-deec4e383723]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[47918e4c-5b61-4eae-ab6d-d8f2bb274745]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a (non-flash)
Nov 15 01:54:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a (non-flash)
Nov 15 01:54:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d0729bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[119d9f40-a471-47cb-b9c1-8d86af13a38d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27f3c8-2f33-43a3-bc63-f682fd01e559]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[95978041-e8a9-423b-a01f-a93565195df2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa21b53-3f40-4fb6-9cd0-05ee0e31294c]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f34f1cf-4ddb-4184-81f1-67cb48d59383]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f13df4-8e94-4943-a636-1f190d82c423]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260]
Nov 15 01:54:46 user nova-compute[74880]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a, portal: 172.16.0.220,3260] successful.
Nov 15 01:54:46 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb41669c-6b72-4598-83a5-922664a2170a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a781a61-e5b5-46e2-8932-4bb3ecb54a8e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] <== disconnect_volume: return (324ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:54:46 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:54:47 user nova-compute[74880]: DEBUG nova.objects.instance [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'flavor' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:54:47 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-dabbe6fa-151a-49e6-b930-221b8ed47283 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:54:50 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:54:55 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:05 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:11 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:55:14 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [{"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-58807500-152d-4a4f-b8fe-1c757f914d0d" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:55:15 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:55:16 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:55:16 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.16763687133789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 58807500-152d-4a4f-b8fe-1c757f914d0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:55:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:18 user nova-compute[74880]: INFO nova.compute.manager [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Terminating instance
Nov 15 01:55:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-c30c612a-e0ef-4d6f-ba01-4c4e63975c66 req-c6819738-0925-47ac-8d3a-eac0c0bb8f08 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-unplugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c30c612a-e0ef-4d6f-ba01-4c4e63975c66 req-c6819738-0925-47ac-8d3a-eac0c0bb8f08 service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c30c612a-e0ef-4d6f-ba01-4c4e63975c66 req-c6819738-0925-47ac-8d3a-eac0c0bb8f08 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c30c612a-e0ef-4d6f-ba01-4c4e63975c66 req-c6819738-0925-47ac-8d3a-eac0c0bb8f08 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-c30c612a-e0ef-4d6f-ba01-4c4e63975c66 req-c6819738-0925-47ac-8d3a-eac0c0bb8f08 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-unplugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG nova.compute.manager [req-c30c612a-e0ef-4d6f-ba01-4c4e63975c66 req-c6819738-0925-47ac-8d3a-eac0c0bb8f08 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-unplugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:55:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Instance destroyed successfully.
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.objects.instance [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lazy-loading 'resources' on Instance uuid 58807500-152d-4a4f-b8fe-1c757f914d0d {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-219238462',display_name='tempest-TestMinimumBasicScenario-server-219238462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-219238462',id=51,image_ref='2ed2bdd0-f03a-4bb5-9fd5-246681decca0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcVsU1oW/yptECmYhB+g6WH0qSCETVx35uJUfSw0mOVCvT78stm3VH+lfTdiv8j4ihD8T8PVX+3SnMgbaQif5cX8j3oP7CZpJly2Hd94+O6Xa0RnERq/fDtZ9Rw4zyN6w==',key_name='tempest-TestMinimumBasicScenario-2062377927',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:50:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548b186a8faa471ab7e009fbe3432923',ramdisk_id='',reservation_id='r-k9nuyo5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ed2bdd0-f03a-4bb5-9fd5-246681decca0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2025011480',owner_user_name='tempest-TestMinimumBasicScenario-2025011480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:52:40Z,user_data=None,user_id='7dc61549e25c4d10b9b8bd0422bdba76',uuid=58807500-152d-4a4f-b8fe-1c757f914d0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converting VIF {"id": "93db99b9-7656-4e5c-a328-91f861ba00cc", "address": "fa:16:3e:bf:c0:b0", "network": {"id": "71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1747122723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548b186a8faa471ab7e009fbe3432923", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93db99b9-76", "ovs_interfaceid": "93db99b9-7656-4e5c-a328-91f861ba00cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG os_vif [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93db99b9-76, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f09963b-70d4-440d-b630-01167343ebd5) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: INFO os_vif [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c0:b0,bridge_name='br-int',has_traffic_filtering=True,id=93db99b9-7656-4e5c-a328-91f861ba00cc,network=Network(71ca0e07-3d0f-4426-a0f1-b6078c6bdeb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93db99b9-76')
Nov 15 01:55:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Deleting instance files /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d_del
Nov 15 01:55:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Deletion of /opt/stack/data/nova/instances/58807500-152d-4a4f-b8fe-1c757f914d0d_del complete
Nov 15 01:55:19 user nova-compute[74880]: INFO nova.compute.manager [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 01:55:19 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:55:19 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Took 0.42 seconds to deallocate network for instance.
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.compute.manager [req-d15c23a6-75c9-445b-9398-ce95c33c793e req-7c1fdbfb-9ce7-481f-94d7-f9e9a1d5d066 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-deleted-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:55:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:19 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Deleted allocations for instance 58807500-152d-4a4f-b8fe-1c757f914d0d
Nov 15 01:55:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-44916c79-2f6e-4690-974b-637575cc0654 tempest-TestMinimumBasicScenario-2025011480 tempest-TestMinimumBasicScenario-2025011480-project-member] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.651s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-b33b9ce2-9e04-4cf4-a1bd-4aa058481407 req-895f99de-2a83-4613-8224-477b8bf9b749 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:55:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b33b9ce2-9e04-4cf4-a1bd-4aa058481407 req-895f99de-2a83-4613-8224-477b8bf9b749 service nova] Acquiring lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:55:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b33b9ce2-9e04-4cf4-a1bd-4aa058481407 req-895f99de-2a83-4613-8224-477b8bf9b749 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:55:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b33b9ce2-9e04-4cf4-a1bd-4aa058481407 req-895f99de-2a83-4613-8224-477b8bf9b749 service nova] Lock "58807500-152d-4a4f-b8fe-1c757f914d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:55:20 user nova-compute[74880]: DEBUG nova.compute.manager [req-b33b9ce2-9e04-4cf4-a1bd-4aa058481407 req-895f99de-2a83-4613-8224-477b8bf9b749 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] No waiting events found dispatching network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:55:20 user nova-compute[74880]: WARNING nova.compute.manager [req-b33b9ce2-9e04-4cf4-a1bd-4aa058481407 req-895f99de-2a83-4613-8224-477b8bf9b749 service nova] [instance: 58807500-152d-4a4f-b8fe-1c757f914d0d] Received unexpected event network-vif-plugged-93db99b9-7656-4e5c-a328-91f861ba00cc for instance with vm_state deleted and task_state None.
Nov 15 01:55:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:55:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 01:55:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 01:55:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:55:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:55:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:55:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:35 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:55:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 01:55:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:55:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:55:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:55:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:55:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:55:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:56:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:56:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:56:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:14 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:56:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:56:14 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 01:56:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:16 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:56:17 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:56:17 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:56:17 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=25.234397888183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:56:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:19 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:19 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:21 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:56:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:25 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 01:56:30 user nova-compute[74880]: INFO nova.compute.claims [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Claim successful on node user
Nov 15 01:56:30 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 01:56:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.policy [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a08191d63a8b4175913d48b8ee9d2c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eb94f213944ee5973f50733771f724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 01:56:31 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Creating image(s)
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "/opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "/opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk 1073741824" returned: 0 in 0.050s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.190s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Successfully created port: 9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Cannot resize image /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Ensure instance console log exists: /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:31 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Successfully updated port: 9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquired lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-changed-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.compute.manager [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Refreshing instance network info cache due to event network-changed-9095e6be-2842-4484-ac16-6b1adeecddc5. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] Acquiring lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.neutron [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Releasing lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Instance network_info: |[{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] Acquired lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.neutron [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Refreshing network info cache for port 9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Start _get_guest_xml network_info=[{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 01:56:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:56:32 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1222357',id=52,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDczZjFjUiLGMMYgHJs3ABZk1tLrxvq6CdhqEWpCKh7RPfcS30WUFKpqf8aOJcT8SAdRoe03ade6wBV+r95oMZtWDm19xgL0hwZSUfIuGOvlLppsLD9NWlTkhFu7/CjIQ==',key_name='tempest-keypair-48146811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1eb94f213944ee5973f50733771f724',ramdisk_id='',reservation_id='r-yopbf5ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1540079189',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08191d63a8b4175913d48b8ee9d2c28',uuid=1b648f2d-f5ec-4b95-a367-5ee1a132a619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Converting VIF {"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.objects.instance [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] End _get_guest_xml xml=<domain type="kvm">
Nov 15 01:56:32 user nova-compute[74880]:   <uuid>1b648f2d-f5ec-4b95-a367-5ee1a132a619</uuid>
Nov 15 01:56:32 user nova-compute[74880]:   <name>instance-00000034</name>
Nov 15 01:56:32 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 01:56:32 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 01:56:32 user nova-compute[74880]:   <metadata>
Nov 15 01:56:32 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 01:56:32 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 01:56:32 user nova-compute[74880]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862</nova:name>
Nov 15 01:56:32 user nova-compute[74880]:       <nova:creationTime>2023-11-15 01:56:32</nova:creationTime>
Nov 15 01:56:32 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 01:56:32 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 01:56:32 user nova-compute[74880]:       </nova:flavor>
Nov 15 01:56:32 user nova-compute[74880]:       <nova:owner>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:user uuid="a08191d63a8b4175913d48b8ee9d2c28">tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member</nova:user>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:project uuid="b1eb94f213944ee5973f50733771f724">tempest-TestServerVolumeAttachScenarioOldVersion-1540079189</nova:project>
Nov 15 01:56:32 user nova-compute[74880]:       </nova:owner>
Nov 15 01:56:32 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 01:56:32 user nova-compute[74880]:       <nova:ports>
Nov 15 01:56:32 user nova-compute[74880]:         <nova:port uuid="9095e6be-2842-4484-ac16-6b1adeecddc5">
Nov 15 01:56:32 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 01:56:32 user nova-compute[74880]:         </nova:port>
Nov 15 01:56:32 user nova-compute[74880]:       </nova:ports>
Nov 15 01:56:32 user nova-compute[74880]:     </nova:instance>
Nov 15 01:56:32 user nova-compute[74880]:   </metadata>
Nov 15 01:56:32 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 01:56:32 user nova-compute[74880]:     <system>
Nov 15 01:56:32 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 01:56:32 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 01:56:32 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 01:56:32 user nova-compute[74880]:       <entry name="serial">1b648f2d-f5ec-4b95-a367-5ee1a132a619</entry>
Nov 15 01:56:32 user nova-compute[74880]:       <entry name="uuid">1b648f2d-f5ec-4b95-a367-5ee1a132a619</entry>
Nov 15 01:56:32 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 01:56:32 user nova-compute[74880]:     </system>
Nov 15 01:56:32 user nova-compute[74880]:   </sysinfo>
Nov 15 01:56:32 user nova-compute[74880]:   <os>
Nov 15 01:56:32 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 01:56:32 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 01:56:32 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 01:56:32 user nova-compute[74880]:   </os>
Nov 15 01:56:32 user nova-compute[74880]:   <features>
Nov 15 01:56:32 user nova-compute[74880]:     <acpi/>
Nov 15 01:56:32 user nova-compute[74880]:     <apic/>
Nov 15 01:56:32 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 01:56:32 user nova-compute[74880]:   </features>
Nov 15 01:56:32 user nova-compute[74880]:   <clock offset="utc">
Nov 15 01:56:32 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 01:56:32 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 01:56:32 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 01:56:32 user nova-compute[74880]:   </clock>
Nov 15 01:56:32 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 01:56:32 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 01:56:32 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 01:56:32 user nova-compute[74880]:   </cpu>
Nov 15 01:56:32 user nova-compute[74880]:   <devices>
Nov 15 01:56:32 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 01:56:32 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 01:56:32 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk"/>
Nov 15 01:56:32 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 01:56:32 user nova-compute[74880]:     </disk>
Nov 15 01:56:32 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 01:56:32 user nova-compute[74880]:       <mac address="fa:16:3e:2f:e5:84"/>
Nov 15 01:56:32 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:56:32 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 01:56:32 user nova-compute[74880]:       <target dev="tap9095e6be-28"/>
Nov 15 01:56:32 user nova-compute[74880]:     </interface>
Nov 15 01:56:32 user nova-compute[74880]:     <serial type="pty">
Nov 15 01:56:32 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/console.log" append="off"/>
Nov 15 01:56:32 user nova-compute[74880]:     </serial>
Nov 15 01:56:32 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 01:56:32 user nova-compute[74880]:     <video>
Nov 15 01:56:32 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 01:56:32 user nova-compute[74880]:     </video>
Nov 15 01:56:32 user nova-compute[74880]:     <rng model="virtio">
Nov 15 01:56:32 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 01:56:32 user nova-compute[74880]:     </rng>
Nov 15 01:56:32 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 01:56:32 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 01:56:32 user nova-compute[74880]:       <stats period="10"/>
Nov 15 01:56:32 user nova-compute[74880]:     </memballoon>
Nov 15 01:56:32 user nova-compute[74880]:   </devices>
Nov 15 01:56:32 user nova-compute[74880]: </domain>
Nov 15 01:56:32 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1222357',id=52,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDczZjFjUiLGMMYgHJs3ABZk1tLrxvq6CdhqEWpCKh7RPfcS30WUFKpqf8aOJcT8SAdRoe03ade6wBV+r95oMZtWDm19xgL0hwZSUfIuGOvlLppsLD9NWlTkhFu7/CjIQ==',key_name='tempest-keypair-48146811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1eb94f213944ee5973f50733771f724',ramdisk_id='',reservation_id='r-yopbf5ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1540079189',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T01:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08191d63a8b4175913d48b8ee9d2c28',uuid=1b648f2d-f5ec-4b95-a367-5ee1a132a619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Converting VIF {"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG os_vif [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e2b2f83-eeb0-5d92-8906-61aae8b7a1ad', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9095e6be-28, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9095e6be-28, col_values=(('qos', UUID('d718d61d-d75a-4899-b41b-99cd268d88d1')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9095e6be-28, col_values=(('external_ids', {'iface-id': '9095e6be-2842-4484-ac16-6b1adeecddc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e5:84', 'vm-uuid': '1b648f2d-f5ec-4b95-a367-5ee1a132a619'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:32 user nova-compute[74880]: INFO os_vif [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28')
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] No VIF found with MAC fa:16:3e:2f:e5:84, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:56:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updated VIF entry in instance network info cache for port 9095e6be-2842-4484-ac16-6b1adeecddc5. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:56:33 user nova-compute[74880]: DEBUG nova.network.neutron [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:56:33 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c31a34fe-1f8d-4ea6-9117-3e92bbcf2324 req-22b93815-4901-4841-98e7-29d9448134fb service nova] Releasing lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b4a254b-6810-462a-8842-3165f02f2521 req-82feadf1-e06a-44af-a80d-9cf3cc1ad15d service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b4a254b-6810-462a-8842-3165f02f2521 req-82feadf1-e06a-44af-a80d-9cf3cc1ad15d service nova] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b4a254b-6810-462a-8842-3165f02f2521 req-82feadf1-e06a-44af-a80d-9cf3cc1ad15d service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-2b4a254b-6810-462a-8842-3165f02f2521 req-82feadf1-e06a-44af-a80d-9cf3cc1ad15d service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG nova.compute.manager [req-2b4a254b-6810-462a-8842-3165f02f2521 req-82feadf1-e06a-44af-a80d-9cf3cc1ad15d service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] No waiting events found dispatching network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:56:34 user nova-compute[74880]: WARNING nova.compute.manager [req-2b4a254b-6810-462a-8842-3165f02f2521 req-82feadf1-e06a-44af-a80d-9cf3cc1ad15d service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received unexpected event network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 for instance with vm_state building and task_state spawning.
Nov 15 01:56:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 01:56:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Instance spawned successfully.
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 01:56:36 user nova-compute[74880]: INFO nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 01:56:36 user nova-compute[74880]: INFO nova.compute.manager [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Took 5.73 seconds to build instance.
Nov 15 01:56:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-0701f644-cb9d-4183-8e58-241c50895389 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.830s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-b81e7c57-a385-402c-9de8-8914e1380e61 req-b2ef9c2b-1750-415b-932b-774aa7f352c9 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b81e7c57-a385-402c-9de8-8914e1380e61 req-b2ef9c2b-1750-415b-932b-774aa7f352c9 service nova] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b81e7c57-a385-402c-9de8-8914e1380e61 req-b2ef9c2b-1750-415b-932b-774aa7f352c9 service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-b81e7c57-a385-402c-9de8-8914e1380e61 req-b2ef9c2b-1750-415b-932b-774aa7f352c9 service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:56:36 user nova-compute[74880]: DEBUG nova.compute.manager [req-b81e7c57-a385-402c-9de8-8914e1380e61 req-b2ef9c2b-1750-415b-932b-774aa7f352c9 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] No waiting events found dispatching network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:56:36 user nova-compute[74880]: WARNING nova.compute.manager [req-b81e7c57-a385-402c-9de8-8914e1380e61 req-b2ef9c2b-1750-415b-932b-774aa7f352c9 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received unexpected event network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 for instance with vm_state active and task_state None.
Nov 15 01:56:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:56:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:13 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:57:15 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:57:16 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:57:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:57:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:57:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:57:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:57:18 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:57:19 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:57:19 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.20392608642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:57:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:57:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:24 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:57:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:57:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:57:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:57:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:57:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:57:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:57:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:57:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:57:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:57:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:58:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:58:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:58:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:58:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:58:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:58:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:15 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:58:16 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:58:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:58:20 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:21 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:58:21 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.203350067138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-changed-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.compute.manager [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Refreshing instance network info cache due to event network-changed-9095e6be-2842-4484-ac16-6b1adeecddc5. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] Acquiring lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] Acquired lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:58:21 user nova-compute[74880]: DEBUG nova.network.neutron [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Refreshing network info cache for port 9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 01:58:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updated VIF entry in instance network info cache for port 9095e6be-2842-4484-ac16-6b1adeecddc5. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 01:58:22 user nova-compute[74880]: DEBUG nova.network.neutron [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:58:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-bf8595e4-ba54-41fb-99a9-fdfa71254848 req-9f87cc39-70e0-4153-ae51-0012673412ae service nova] Releasing lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:58:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:58:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:58:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lazy-loading 'flavor' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:58:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:58:24 user nova-compute[74880]: INFO nova.compute.manager [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Attaching volume 26c92b9c-74ee-46c0-b672-feca4530e5ee to /dev/vdb
Nov 15 01:58:24 user nova-compute[74880]: DEBUG os_brick.utils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bcec03-4061-4086-bc10-84a4de07fe41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80eb35c-3a6c-414d-b075-3ec0a6c31165]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd917f69-2357-468f-9822-815ee249e4eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c88fdd-c13b-4163-b2b8-21fa4db1e591]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 01:58:24 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 01:58:24 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3578637-ea20-474b-af61-f5b873ffb472]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG os_brick.utils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:58:24 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating existing volume attachment record: 935280ac-cfe2-4803-893f-9916ba3f2c70 {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 01:58:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:58:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRwbYdzp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:58:28 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:58:28 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:58:28 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176c4db-cbce-441d-bafc-bc0ec29e02c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 01:58:28 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2763b3-ff79-48e0-807d-4a083cb69e33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee] added
Nov 15 01:58:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e3c97-416d-4d20-adb4-a872810bf1f2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c2de1-9964-46f9-9004-85d8fbc49f6e]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRwbYdzp {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRwbYdzp" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b489f220-3770-40c1-81aa-1ff3a2c18001]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRwbYdzp'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c829f-cd79-42a9-af4f-2a06e6dfa302]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61de17-2907-418e-85e6-36911496cf27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:58:28 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 01:58:28 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:58:28 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 01:58:28 user nova-compute[74880]: 
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dcf8c5-1500-4ef7-8210-008ec1fca124]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260]
Nov 15 01:58:28 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260] successful.
Nov 15 01:58:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b685ce5a-8dea-4320-967d-7eafb54f4c0c]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ef21d5-fc82-4500-a4ee-0fd79e9c15ff]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee (non-flash)
Nov 15 01:58:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee (non-flash)
Nov 15 01:58:28 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f71ded4-171f-40cd-9cd9-f3132f7888ab]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 01:58:28 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRwbYdzp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 01:58:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:58:29 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26630323363383931', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:58:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630323363383931', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 01:58:29 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lazy-loading 'flavor' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:58:29 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 01:58:29 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:58:29 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:58:29 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:58:29 user nova-compute[74880]:   <serial>26c92b9c-74ee-46c0-b672-feca4530e5ee</serial>
Nov 15 01:58:29 user nova-compute[74880]: </disk>
Nov 15 01:58:29 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 01:58:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:58:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 01:58:30 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] No VIF found with MAC fa:16:3e:2f:e5:84, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 01:58:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2f14400-8372-4db1-baec-878de320fbdd tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.485s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:58:32 user nova-compute[74880]: INFO nova.compute.manager [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Detaching volume 26c92b9c-74ee-46c0-b672-feca4530e5ee
Nov 15 01:58:32 user nova-compute[74880]: INFO nova.virt.block_device [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Attempting to driver detach volume 26c92b9c-74ee-46c0-b672-feca4530e5ee from mountpoint /dev/vdb
Nov 15 01:58:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Attempting to detach device vdb from instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:58:32 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:58:32 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:58:32 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:58:32 user nova-compute[74880]:   <serial>26c92b9c-74ee-46c0-b672-feca4530e5ee</serial>
Nov 15 01:58:32 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:58:32 user nova-compute[74880]: </disk>
Nov 15 01:58:32 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:58:32 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Successfully detached device vdb from instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 from the persistent domain config.
Nov 15 01:58:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 01:58:32 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 01:58:32 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 01:58:32 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 01:58:32 user nova-compute[74880]:   <serial>26c92b9c-74ee-46c0-b672-feca4530e5ee</serial>
Nov 15 01:58:32 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 01:58:32 user nova-compute[74880]: </disk>
Nov 15 01:58:32 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:58:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:58:52 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 is timed out.
Nov 15 01:58:52 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Successfully detached device vdb from instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 from the live domain config.
Nov 15 01:58:52 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRwbYdzp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 01:58:52 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca4b7a-d690-4088-96f7-c36ba992ec60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 01:58:52 user nova-compute[74880]: No targets found.
Nov 15 01:58:52 user nova-compute[74880]: iSNS:
Nov 15 01:58:52 user nova-compute[74880]: No targets found.
Nov 15 01:58:52 user nova-compute[74880]: STATIC:
Nov 15 01:58:52 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee
Nov 15 01:58:52 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 01:58:52 user nova-compute[74880]:                 Iface Name: default
Nov 15 01:58:52 user nova-compute[74880]: FIRMWARE:
Nov 15 01:58:52 user nova-compute[74880]: No targets found.
Nov 15 01:58:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 01:58:52 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 01:58:52 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8aadf-cc7c-46d0-8527-5ea4d8457cd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[565cf1e2-e3a3-4949-9d38-ed195880e3ff]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee (non-flash)
Nov 15 01:58:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee (non-flash)
Nov 15 01:58:52 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d05485e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca1e7a9-adfd-4826-9774-7fa6d17dad2c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bcda3-95d3-44c0-8500-3d3ffe404a6a]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afe1091-8363-4bc1-ab85-9a65297c7c00]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90554d1-e608-478d-8f9c-af8bbec1d830]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b6902-554f-404e-87b1-58dca5eda170]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[599dcd6d-d567-4503-81b2-09ef24ffc60f]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260]
Nov 15 01:58:53 user nova-compute[74880]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee, portal: 172.16.0.220,3260] successful.
Nov 15 01:58:53 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c92b9c-74ee-46c0-b672-feca4530e5ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbfe9cc-f8e5-4221-9109-26e45785726f]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] <== disconnect_volume: return (288ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG nova.objects.instance [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lazy-loading 'flavor' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:58:53 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-ac7fbc6c-8e78-45a9-bb2a-bd16149981d4 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.631s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:58:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:59:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:59:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:12 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:18 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [{"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:59:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-1b648f2d-f5ec-4b95-a367-5ee1a132a619" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 01:59:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 01:59:21 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 01:59:22 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:59:22 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.20218276977539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 01:59:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:26 user nova-compute[74880]: INFO nova.compute.manager [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Terminating instance
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-034574ed-79c0-41ca-b1f2-c4ce382166e9 req-573767de-9d36-478e-9aa3-6923008a2606 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-vif-unplugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-034574ed-79c0-41ca-b1f2-c4ce382166e9 req-573767de-9d36-478e-9aa3-6923008a2606 service nova] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-034574ed-79c0-41ca-b1f2-c4ce382166e9 req-573767de-9d36-478e-9aa3-6923008a2606 service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-034574ed-79c0-41ca-b1f2-c4ce382166e9 req-573767de-9d36-478e-9aa3-6923008a2606 service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-034574ed-79c0-41ca-b1f2-c4ce382166e9 req-573767de-9d36-478e-9aa3-6923008a2606 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] No waiting events found dispatching network-vif-unplugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.compute.manager [req-034574ed-79c0-41ca-b1f2-c4ce382166e9 req-573767de-9d36-478e-9aa3-6923008a2606 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-vif-unplugged-9095e6be-2842-4484-ac16-6b1adeecddc5 for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 01:59:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Instance destroyed successfully.
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.objects.instance [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lazy-loading 'resources' on Instance uuid 1b648f2d-f5ec-4b95-a367-5ee1a132a619 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T01:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222357862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1222357',id=52,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDczZjFjUiLGMMYgHJs3ABZk1tLrxvq6CdhqEWpCKh7RPfcS30WUFKpqf8aOJcT8SAdRoe03ade6wBV+r95oMZtWDm19xgL0hwZSUfIuGOvlLppsLD9NWlTkhFu7/CjIQ==',key_name='tempest-keypair-48146811',keypairs=<?>,launch_index=0,launched_at=2023-11-15T01:56:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1eb94f213944ee5973f50733771f724',ramdisk_id='',reservation_id='r-yopbf5ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1540079189',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T01:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08191d63a8b4175913d48b8ee9d2c28',uuid=1b648f2d-f5ec-4b95-a367-5ee1a132a619,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Converting VIF {"id": "9095e6be-2842-4484-ac16-6b1adeecddc5", "address": "fa:16:3e:2f:e5:84", "network": {"id": "d45f4242-5047-42ae-b301-42c7af4515eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2131265526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1eb94f213944ee5973f50733771f724", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9095e6be-28", "ovs_interfaceid": "9095e6be-2842-4484-ac16-6b1adeecddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG os_vif [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9095e6be-28, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d718d61d-d75a-4899-b41b-99cd268d88d1) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:26 user nova-compute[74880]: INFO os_vif [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e5:84,bridge_name='br-int',has_traffic_filtering=True,id=9095e6be-2842-4484-ac16-6b1adeecddc5,network=Network(d45f4242-5047-42ae-b301-42c7af4515eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9095e6be-28')
Nov 15 01:59:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Deleting instance files /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619_del
Nov 15 01:59:26 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Deletion of /opt/stack/data/nova/instances/1b648f2d-f5ec-4b95-a367-5ee1a132a619_del complete
Nov 15 01:59:26 user nova-compute[74880]: INFO nova.compute.manager [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 01:59:26 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 01:59:26 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 01:59:27 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 01:59:27 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Took 0.64 seconds to deallocate network for instance.
Nov 15 01:59:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:27 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 01:59:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 01:59:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:27 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Deleted allocations for instance 1b648f2d-f5ec-4b95-a367-5ee1a132a619
Nov 15 01:59:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-c25a6d48-09b4-4832-8b27-c3f19d9f2444 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189 tempest-TestServerVolumeAttachScenarioOldVersion-1540079189-project-member] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.811s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:59:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] Acquiring lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 01:59:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 01:59:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] Lock "1b648f2d-f5ec-4b95-a367-5ee1a132a619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 01:59:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] No waiting events found dispatching network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 01:59:28 user nova-compute[74880]: WARNING nova.compute.manager [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received unexpected event network-vif-plugged-9095e6be-2842-4484-ac16-6b1adeecddc5 for instance with vm_state deleted and task_state None.
Nov 15 01:59:28 user nova-compute[74880]: DEBUG nova.compute.manager [req-0bcd4602-8d51-4753-b584-c4a4a2a40b83 req-63fead00-1d45-42fb-a8b9-5b9a3e6b33b5 service nova] [instance: 1b648f2d-f5ec-4b95-a367-5ee1a132a619] Received event network-vif-deleted-9095e6be-2842-4484-ac16-6b1adeecddc5 {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 01:59:28 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 01:59:31 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:41 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:46 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 01:59:51 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 01:59:56 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:01 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:00:06 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:00:16 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:17 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:00:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:00:17 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:00:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:00:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:00:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:00:21 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:22 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:00:22 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=25.229103088378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:00:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:00:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:27 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:27 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:00:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:32 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 02:00:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 02:00:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:00:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:00:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:00:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:00:37 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:42 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:00:42 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:47 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 02:00:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:52 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:53 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:00:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:57 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:00:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:00 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:02 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:05 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Starting instance... {{(pid=74880) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 02:01:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:05 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74880) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 02:01:06 user nova-compute[74880]: INFO nova.compute.claims [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Claim successful on node user
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Start building networks asynchronously for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Allocating IP information in the background. {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] allocate_for_instance() {{(pid=74880) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 02:01:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Start building block device mappings for instance. {{(pid=74880) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.policy [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81f6dff5dc294c418de648667b7979e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0681eb78da94b978840014a68473771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74880) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Start spawning the instance on the hypervisor. {{(pid=74880) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Creating instance directory {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 02:01:06 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Creating image(s)
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "/opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "/opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "/opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.199s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.181s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk 1073741824 {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594,backing_fmt=raw /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk 1073741824" returned: 0 in 0.053s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "a7e2af4bfde01ff6d669a7f08b34f85d41541594" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7e2af4bfde01ff6d669a7f08b34f85d41541594 --force-share --output=json" returned: 0 in 0.194s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk. size=1073741824 {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG nova.virt.disk.api [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Cannot resize image /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk to a smaller size. {{(pid=74880) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Created local disks {{(pid=74880) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Ensure instance console log exists: /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/console.log {{(pid=74880) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:07 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Successfully created port: 11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Successfully updated port: 11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Building network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-changed-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG nova.compute.manager [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Refreshing instance network info cache due to event network-changed-11b99bc9-8f22-4086-8608-33001c8413da. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:01:08 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Instance cache missing network info. {{(pid=74880) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.neutron [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Instance network_info: |[{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74880) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Refreshing network info cache for port 11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Start _get_guest_xml network_info=[{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'image_id': '9e9b279c-74a4-42a5-b459-aec607e3df19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 02:01:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:01:09 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CPU controller missing on host. {{(pid=74880) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.host [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CPU controller found on host. {{(pid=74880) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74880) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T01:09:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T01:10:00Z,direct_url=<?>,disk_format='qcow2',id=9e9b279c-74a4-42a5-b459-aec607e3df19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e99168cf57ab48bd8105fd05bffb6e73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T01:10:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Flavor limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Image limits 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Flavor pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Image pref 0:0:0 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Got 1 possible topologies {{(pid=74880) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.hardware [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74880) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1838768601',display_name='tempest-SnapshotDataIntegrityTests-server-1838768601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1838768601',id=53,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe5NpITyt3uuOcOmuiDUiC6/69p4rOq6FBNH5s/+aIOeRdk4YvHjN5GWJxfinR308ddFtJSwFpDvmrO4g8uf3HVMiLcNpyLuxAGF5tb8QM72XJQYgX58TP3vlHbyGBJAA==',key_name='tempest-keypair-1106201018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0681eb78da94b978840014a68473771',ramdisk_id='',reservation_id='r-to9r7kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-580942294',owner_user_name='tempest-SnapshotDataIntegrityTests-580942294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:01:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81f6dff5dc294c418de648667b7979e4',uuid=86be2742-52a8-4266-a0c3-e6ec542de060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74880) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Converting VIF {"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'pci_devices' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] End _get_guest_xml xml=<domain type="kvm">
Nov 15 02:01:09 user nova-compute[74880]:   <uuid>86be2742-52a8-4266-a0c3-e6ec542de060</uuid>
Nov 15 02:01:09 user nova-compute[74880]:   <name>instance-00000035</name>
Nov 15 02:01:09 user nova-compute[74880]:   <memory>524288</memory>
Nov 15 02:01:09 user nova-compute[74880]:   <vcpu>1</vcpu>
Nov 15 02:01:09 user nova-compute[74880]:   <metadata>
Nov 15 02:01:09 user nova-compute[74880]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 02:01:09 user nova-compute[74880]:       <nova:package version="0.0.0"/>
Nov 15 02:01:09 user nova-compute[74880]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1838768601</nova:name>
Nov 15 02:01:09 user nova-compute[74880]:       <nova:creationTime>2023-11-15 02:01:09</nova:creationTime>
Nov 15 02:01:09 user nova-compute[74880]:       <nova:flavor name="m1.tiny">
Nov 15 02:01:09 user nova-compute[74880]:         <nova:memory>512</nova:memory>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:disk>1</nova:disk>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:swap>0</nova:swap>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:vcpus>1</nova:vcpus>
Nov 15 02:01:09 user nova-compute[74880]:       </nova:flavor>
Nov 15 02:01:09 user nova-compute[74880]:       <nova:owner>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:user uuid="81f6dff5dc294c418de648667b7979e4">tempest-SnapshotDataIntegrityTests-580942294-project-member</nova:user>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:project uuid="a0681eb78da94b978840014a68473771">tempest-SnapshotDataIntegrityTests-580942294</nova:project>
Nov 15 02:01:09 user nova-compute[74880]:       </nova:owner>
Nov 15 02:01:09 user nova-compute[74880]:       <nova:root type="image" uuid="9e9b279c-74a4-42a5-b459-aec607e3df19"/>
Nov 15 02:01:09 user nova-compute[74880]:       <nova:ports>
Nov 15 02:01:09 user nova-compute[74880]:         <nova:port uuid="11b99bc9-8f22-4086-8608-33001c8413da">
Nov 15 02:01:09 user nova-compute[74880]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 02:01:09 user nova-compute[74880]:         </nova:port>
Nov 15 02:01:09 user nova-compute[74880]:       </nova:ports>
Nov 15 02:01:09 user nova-compute[74880]:     </nova:instance>
Nov 15 02:01:09 user nova-compute[74880]:   </metadata>
Nov 15 02:01:09 user nova-compute[74880]:   <sysinfo type="smbios">
Nov 15 02:01:09 user nova-compute[74880]:     <system>
Nov 15 02:01:09 user nova-compute[74880]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 02:01:09 user nova-compute[74880]:       <entry name="product">OpenStack Nova</entry>
Nov 15 02:01:09 user nova-compute[74880]:       <entry name="version">0.0.0</entry>
Nov 15 02:01:09 user nova-compute[74880]:       <entry name="serial">86be2742-52a8-4266-a0c3-e6ec542de060</entry>
Nov 15 02:01:09 user nova-compute[74880]:       <entry name="uuid">86be2742-52a8-4266-a0c3-e6ec542de060</entry>
Nov 15 02:01:09 user nova-compute[74880]:       <entry name="family">Virtual Machine</entry>
Nov 15 02:01:09 user nova-compute[74880]:     </system>
Nov 15 02:01:09 user nova-compute[74880]:   </sysinfo>
Nov 15 02:01:09 user nova-compute[74880]:   <os>
Nov 15 02:01:09 user nova-compute[74880]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 02:01:09 user nova-compute[74880]:     <boot dev="hd"/>
Nov 15 02:01:09 user nova-compute[74880]:     <smbios mode="sysinfo"/>
Nov 15 02:01:09 user nova-compute[74880]:   </os>
Nov 15 02:01:09 user nova-compute[74880]:   <features>
Nov 15 02:01:09 user nova-compute[74880]:     <acpi/>
Nov 15 02:01:09 user nova-compute[74880]:     <apic/>
Nov 15 02:01:09 user nova-compute[74880]:     <vmcoreinfo/>
Nov 15 02:01:09 user nova-compute[74880]:   </features>
Nov 15 02:01:09 user nova-compute[74880]:   <clock offset="utc">
Nov 15 02:01:09 user nova-compute[74880]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 02:01:09 user nova-compute[74880]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 02:01:09 user nova-compute[74880]:     <timer name="hpet" present="no"/>
Nov 15 02:01:09 user nova-compute[74880]:   </clock>
Nov 15 02:01:09 user nova-compute[74880]:   <cpu mode="custom" match="exact">
Nov 15 02:01:09 user nova-compute[74880]:     <model>Nehalem</model>
Nov 15 02:01:09 user nova-compute[74880]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 02:01:09 user nova-compute[74880]:   </cpu>
Nov 15 02:01:09 user nova-compute[74880]:   <devices>
Nov 15 02:01:09 user nova-compute[74880]:     <disk type="file" device="disk">
Nov 15 02:01:09 user nova-compute[74880]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 02:01:09 user nova-compute[74880]:       <source file="/opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk"/>
Nov 15 02:01:09 user nova-compute[74880]:       <target dev="vda" bus="virtio"/>
Nov 15 02:01:09 user nova-compute[74880]:     </disk>
Nov 15 02:01:09 user nova-compute[74880]:     <interface type="ethernet">
Nov 15 02:01:09 user nova-compute[74880]:       <mac address="fa:16:3e:e8:ad:74"/>
Nov 15 02:01:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 02:01:09 user nova-compute[74880]:       <mtu size="1442"/>
Nov 15 02:01:09 user nova-compute[74880]:       <target dev="tap11b99bc9-8f"/>
Nov 15 02:01:09 user nova-compute[74880]:     </interface>
Nov 15 02:01:09 user nova-compute[74880]:     <serial type="pty">
Nov 15 02:01:09 user nova-compute[74880]:       <log file="/opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/console.log" append="off"/>
Nov 15 02:01:09 user nova-compute[74880]:     </serial>
Nov 15 02:01:09 user nova-compute[74880]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 02:01:09 user nova-compute[74880]:     <video>
Nov 15 02:01:09 user nova-compute[74880]:       <model type="virtio"/>
Nov 15 02:01:09 user nova-compute[74880]:     </video>
Nov 15 02:01:09 user nova-compute[74880]:     <rng model="virtio">
Nov 15 02:01:09 user nova-compute[74880]:       <backend model="random">/dev/urandom</backend>
Nov 15 02:01:09 user nova-compute[74880]:     </rng>
Nov 15 02:01:09 user nova-compute[74880]:     <controller type="usb" index="0" model="none"/>
Nov 15 02:01:09 user nova-compute[74880]:     <memballoon model="virtio">
Nov 15 02:01:09 user nova-compute[74880]:       <stats period="10"/>
Nov 15 02:01:09 user nova-compute[74880]:     </memballoon>
Nov 15 02:01:09 user nova-compute[74880]:   </devices>
Nov 15 02:01:09 user nova-compute[74880]: </domain>
Nov 15 02:01:09 user nova-compute[74880]:  {{(pid=74880) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1838768601',display_name='tempest-SnapshotDataIntegrityTests-server-1838768601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1838768601',id=53,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe5NpITyt3uuOcOmuiDUiC6/69p4rOq6FBNH5s/+aIOeRdk4YvHjN5GWJxfinR308ddFtJSwFpDvmrO4g8uf3HVMiLcNpyLuxAGF5tb8QM72XJQYgX58TP3vlHbyGBJAA==',key_name='tempest-keypair-1106201018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0681eb78da94b978840014a68473771',ramdisk_id='',reservation_id='r-to9r7kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-580942294',owner_user_name='tempest-SnapshotDataIntegrityTests-580942294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T02:01:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81f6dff5dc294c418de648667b7979e4',uuid=86be2742-52a8-4266-a0c3-e6ec542de060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Converting VIF {"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG os_vif [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f') {{(pid=74880) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a364133e-c0ae-5571-bde4-aff841a4eb2e', '_type': 'linux-noop'}}, row=False) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b99bc9-8f, may_exist=True, interface_attrs={}) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11b99bc9-8f, col_values=(('qos', UUID('3b1b1bf2-87b4-44be-b17a-6e03532cf8ca')),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11b99bc9-8f, col_values=(('external_ids', {'iface-id': '11b99bc9-8f22-4086-8608-33001c8413da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ad:74', 'vm-uuid': '86be2742-52a8-4266-a0c3-e6ec542de060'}),), if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:09 user nova-compute[74880]: INFO os_vif [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f')
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No VIF found with MAC fa:16:3e:e8:ad:74, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated VIF entry in instance network info cache for port 11b99bc9-8f22-4086-8608-33001c8413da. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG nova.network.neutron [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:01:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-c8a2ce41-16cc-49ff-9392-5ea4d114b5bb req-d90e23f3-a706-4856-9a3a-32bd64d6421a service nova] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:01:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:10 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc3dd626-fd93-45f9-8653-a60fb580a5f7 req-fc86f8cc-0da2-4e7c-87f6-96bb8f6ac510 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc3dd626-fd93-45f9-8653-a60fb580a5f7 req-fc86f8cc-0da2-4e7c-87f6-96bb8f6ac510 service nova] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc3dd626-fd93-45f9-8653-a60fb580a5f7 req-fc86f8cc-0da2-4e7c-87f6-96bb8f6ac510 service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-dc3dd626-fd93-45f9-8653-a60fb580a5f7 req-fc86f8cc-0da2-4e7c-87f6-96bb8f6ac510 service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG nova.compute.manager [req-dc3dd626-fd93-45f9-8653-a60fb580a5f7 req-fc86f8cc-0da2-4e7c-87f6-96bb8f6ac510 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] No waiting events found dispatching network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:01:11 user nova-compute[74880]: WARNING nova.compute.manager [req-dc3dd626-fd93-45f9-8653-a60fb580a5f7 req-fc86f8cc-0da2-4e7c-87f6-96bb8f6ac510 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received unexpected event network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da for instance with vm_state building and task_state spawning.
Nov 15 02:01:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:11 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-9a9cffe4-f69e-42d5-9622-8dc24862f7cc req-dac74681-64cf-4ebb-9553-d30026453d4a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9a9cffe4-f69e-42d5-9622-8dc24862f7cc req-dac74681-64cf-4ebb-9553-d30026453d4a service nova] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9a9cffe4-f69e-42d5-9622-8dc24862f7cc req-dac74681-64cf-4ebb-9553-d30026453d4a service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-9a9cffe4-f69e-42d5-9622-8dc24862f7cc req-dac74681-64cf-4ebb-9553-d30026453d4a service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.compute.manager [req-9a9cffe4-f69e-42d5-9622-8dc24862f7cc req-dac74681-64cf-4ebb-9553-d30026453d4a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] No waiting events found dispatching network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:01:13 user nova-compute[74880]: WARNING nova.compute.manager [req-9a9cffe4-f69e-42d5-9622-8dc24862f7cc req-dac74681-64cf-4ebb-9553-d30026453d4a service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received unexpected event network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da for instance with vm_state building and task_state spawning.
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Instance event wait completed in 0 seconds for  {{(pid=74880) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Guest created on hypervisor {{(pid=74880) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 02:01:13 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Instance spawned successfully.
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Found default for hw_cdrom_bus of ide {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Found default for hw_disk_bus of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Found default for hw_input_bus of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Found default for hw_pointer_model of None {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Found default for hw_video_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Found default for hw_vif_model of virtio {{(pid=74880) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 02:01:13 user nova-compute[74880]: INFO nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 15 02:01:13 user nova-compute[74880]: DEBUG nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Checking state {{(pid=74880) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 02:01:13 user nova-compute[74880]: INFO nova.compute.manager [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Took 7.55 seconds to build instance.
Nov 15 02:01:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2646d6a8-ed88-4a97-b17b-65be2caf46a9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.657s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:01:18 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:01:19 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:01:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:01:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:01:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:01:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:01:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:01:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:01:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:01:23 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=25.212886810302734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:01:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:01:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 86be2742-52a8-4266-a0c3-e6ec542de060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:01:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:28 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:28 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:01:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:01:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:36 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:01:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:01:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:01:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:01:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:01:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:02:19 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:02:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:02:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:02:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:02:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:02:22 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:02:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:02:23 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=25.18408203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 86be2742-52a8-4266-a0c3-e6ec542de060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:02:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:02:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:30 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:02:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:02:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:02:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:02:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:02:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:02:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-changed-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:02:56 user nova-compute[74880]: DEBUG nova.compute.manager [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Refreshing instance network info cache due to event network-changed-11b99bc9-8f22-4086-8608-33001c8413da. {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 02:02:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:02:56 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:02:56 user nova-compute[74880]: DEBUG nova.network.neutron [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Refreshing network info cache for port 11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 02:02:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated VIF entry in instance network info cache for port 11b99bc9-8f22-4086-8608-33001c8413da. {{(pid=74880) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 02:02:57 user nova-compute[74880]: DEBUG nova.network.neutron [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:02:57 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-d46f6166-066a-4300-93ab-2473f1f16f78 req-2b623c21-2823-4aa3-a604-ba6bae712fe7 service nova] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:02:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:02:59 user nova-compute[74880]: INFO nova.compute.manager [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attaching volume 58282d74-3ed4-4da5-a4ca-1bf9f0550c83 to /dev/vdb
Nov 15 02:02:59 user nova-compute[74880]: DEBUG os_brick.utils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e035aa50-f8bd-430f-8a63-df55ab73727a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b9814-f48f-4fee-a2c2-15ee47d14d35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[51620563-1d4c-468f-bf0e-9724c0c0d8ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf9753f-fda4-420f-bd36-e69bfcea103a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:02:59 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:02:59 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b43575d-9578-412a-8218-a0b242777b49]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG os_brick.utils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:02:59 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating existing volume attachment record: cc65c6d7-ca34-4f3a-89a6-60a939ae0f9d {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:03:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFTegUcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:03:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:03:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:03:04 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d3f76-1122-488b-86c9-71c43f6600db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:03:04 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da302c23-2942-44a3-8590-4e60759f070e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83] added
Nov 15 02:03:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5459280-acfb-4c6f-958e-a754beb90df0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa56ccae-066f-463b-859e-50c38d83d3f5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFTegUcJ {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFTegUcJ" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2825ca3d-3cdd-4372-b4f1-a85946e52426]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LFTegUcJ'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced09b3-e9e3-441b-ab2a-616e80baa412]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cb2f05-a4ec-4a33-a050-1006dc6b4887]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:03:04 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:03:04 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:03:04 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 02:03:04 user nova-compute[74880]: 
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f10c9-3743-4003-841f-76a6bfcc3459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260]
Nov 15 02:03:04 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260] successful.
Nov 15 02:03:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02269ac1-b0ea-4c90-b029-19f959ab59fd]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5967b1-5778-427a-813c-c2b172adc324]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 (non-flash)
Nov 15 02:03:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 (non-flash)
Nov 15 02:03:04 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2415215e-3e2b-4891-9ceb-33a33d04a2f8]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:04 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFTegUcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.257s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== connect_volume: return (1259ms) {'type': 'block', 'scsi_wwn': '23832343930616637', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832343930616637', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:03:05 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:03:05 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:03:05 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:03:05 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:03:05 user nova-compute[74880]:   <serial>58282d74-3ed4-4da5-a4ca-1bf9f0550c83</serial>
Nov 15 02:03:05 user nova-compute[74880]: </disk>
Nov 15 02:03:05 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:03:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:03:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:03:06 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No VIF found with MAC fa:16:3e:e8:ad:74, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:03:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3fb5876a-857e-4e3c-9c11-8dabee64d893 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.573s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:03:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:03:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:03:14 user nova-compute[74880]: INFO nova.compute.manager [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Detaching volume 58282d74-3ed4-4da5-a4ca-1bf9f0550c83
Nov 15 02:03:14 user nova-compute[74880]: INFO nova.virt.block_device [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attempting to driver detach volume 58282d74-3ed4-4da5-a4ca-1bf9f0550c83 from mountpoint /dev/vdb
Nov 15 02:03:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Attempting to detach device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:03:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:03:14 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:03:14 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:03:14 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:03:14 user nova-compute[74880]:   <serial>58282d74-3ed4-4da5-a4ca-1bf9f0550c83</serial>
Nov 15 02:03:14 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:03:14 user nova-compute[74880]: </disk>
Nov 15 02:03:14 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:03:14 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config.
Nov 15 02:03:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:03:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:03:14 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:03:14 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:03:14 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:03:14 user nova-compute[74880]:   <serial>58282d74-3ed4-4da5-a4ca-1bf9f0550c83</serial>
Nov 15 02:03:14 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:03:14 user nova-compute[74880]: </disk>
Nov 15 02:03:14 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:03:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:03:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:03:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:03:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:03:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:03:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:03:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:03:24 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:25 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:03:25 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.18280029296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 86be2742-52a8-4266-a0c3-e6ec542de060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:03:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:03:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:28 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:31 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:03:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:03:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:03:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:03:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:03:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:35 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 is timed out.
Nov 15 02:03:35 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config.
Nov 15 02:03:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFTegUcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:03:35 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d79bb-5511-4fd8-a1c6-bcafbac2f6c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:03:35 user nova-compute[74880]: No targets found.
Nov 15 02:03:35 user nova-compute[74880]: iSNS:
Nov 15 02:03:35 user nova-compute[74880]: No targets found.
Nov 15 02:03:35 user nova-compute[74880]: STATIC:
Nov 15 02:03:35 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83
Nov 15 02:03:35 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:03:35 user nova-compute[74880]:                 Iface Name: default
Nov 15 02:03:35 user nova-compute[74880]: FIRMWARE:
Nov 15 02:03:35 user nova-compute[74880]: No targets found.
Nov 15 02:03:35 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:03:35 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:03:35 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4368f08-9373-4e36-93da-d6c973aa68ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[92992cf5-b4cb-4dff-a2ee-100d0b325b89]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 (non-flash)
Nov 15 02:03:35 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 (non-flash)
Nov 15 02:03:35 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d06cb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45a66a-7e7a-46d5-89f1-fd5f942c426a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11023c99-490b-4900-a653-158196fc3322]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec39f7-f1a5-44f4-aaaf-d4ac736f5a65]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5d8fad-7e47-4423-a41d-547238846f24]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc2173-bf3f-4483-81c3-8664a695219a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ad9f99-825e-4a82-8117-f58dd585cbe6]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260]
Nov 15 02:03:35 user nova-compute[74880]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83, portal: 172.16.0.220,3260] successful.
Nov 15 02:03:35 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58282d74-3ed4-4da5-a4ca-1bf9f0550c83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b4748-ed1f-4e97-889a-327e19b74f93]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== disconnect_volume: return (275ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:03:35 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:03:36 user nova-compute[74880]: DEBUG nova.objects.instance [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:03:36 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-417accd2-3747-4ef3-b292-da11189c6862 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.596s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:03:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:03:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:03:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:03:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:03:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:03:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:03:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:03:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:03:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:03:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:03:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:03:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:03:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:04:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:04:06 user nova-compute[74880]: INFO nova.compute.manager [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attaching volume f2f1d24d-ed87-4eef-88ce-b33755706647 to /dev/vdb
Nov 15 02:04:06 user nova-compute[74880]: DEBUG os_brick.utils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:04:06 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e09d5db-baf9-4089-bcc3-dd38ea74ea92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73247a0-c2fe-4e60-94bf-9e2c0edef2ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868cd69-ee69-4c35-b4b1-ebac8e006fad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe00928-5932-4b0a-8125-4d576cc3ef16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:04:07 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:04:07 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd89f672-8117-4936-a78a-bb2e03acdbac]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG os_brick.utils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:04:07 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating existing volume attachment record: 5e799101-4a1c-4906-b709-a92988cb590d {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:04:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOaWTjGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:04:11 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:04:11 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:04:11 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4054591f-adcb-4061-bb53-ec2cf1dfddb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:04:11 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d839173-88ab-43b3-ae24-6026a0b87cb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647] added
Nov 15 02:04:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fba1b9-9bbb-474a-90f4-4ecf336d61f3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6ebf1-efb4-46b7-9cc4-40539ef30117]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uOaWTjGS {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uOaWTjGS" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ca9c9-1597-44bb-8ae0-044bd8febe1a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uOaWTjGS'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebac11-df5b-40e1-b3da-0667d96d3309]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d13d34c-c8e5-42bb-b56a-617620a8ab3e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:04:11 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:04:11 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:04:11 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 02:04:11 user nova-compute[74880]: 
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad0521-0165-4c4d-bb1b-8bcd46866e3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260]
Nov 15 02:04:11 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260] successful.
Nov 15 02:04:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecefa3e-de4a-497d-b8e3-7f6e3f93a8f0]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d0c9a-08b1-4125-8cc7-d62210d99c65]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 (non-flash)
Nov 15 02:04:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 (non-flash)
Nov 15 02:04:11 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18bab9-5e3d-422f-aed2-f9ceabe85839]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:04:11 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOaWTjGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:04:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:04:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23939316565396139', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:04:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939316565396139', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:04:12 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:04:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:04:12 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:04:12 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:04:12 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:04:12 user nova-compute[74880]:   <serial>f2f1d24d-ed87-4eef-88ce-b33755706647</serial>
Nov 15 02:04:12 user nova-compute[74880]: </disk>
Nov 15 02:04:12 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:04:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:04:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:04:13 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No VIF found with MAC fa:16:3e:e8:ad:74, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:04:13 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2d3e5d6c-5540-46a3-996a-8127a5b4843e tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.507s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:04:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:04:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:04:16 user nova-compute[74880]: INFO nova.compute.manager [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Detaching volume f2f1d24d-ed87-4eef-88ce-b33755706647
Nov 15 02:04:16 user nova-compute[74880]: INFO nova.virt.block_device [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attempting to driver detach volume f2f1d24d-ed87-4eef-88ce-b33755706647 from mountpoint /dev/vdb
Nov 15 02:04:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Attempting to detach device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:04:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:04:16 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:04:16 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:04:16 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:04:16 user nova-compute[74880]:   <serial>f2f1d24d-ed87-4eef-88ce-b33755706647</serial>
Nov 15 02:04:16 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:04:16 user nova-compute[74880]: </disk>
Nov 15 02:04:16 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:04:16 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config.
Nov 15 02:04:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:04:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:04:16 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:04:16 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:04:16 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:04:16 user nova-compute[74880]:   <serial>f2f1d24d-ed87-4eef-88ce-b33755706647</serial>
Nov 15 02:04:16 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:04:16 user nova-compute[74880]: </disk>
Nov 15 02:04:16 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:04:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:04:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:04:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:04:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:04:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:04:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:04:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:23 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:04:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:04:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:04:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.181835174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 86be2742-52a8-4266-a0c3-e6ec542de060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:04:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:04:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:29 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:29 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:04:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:36 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 is timed out.
Nov 15 02:04:36 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config.
Nov 15 02:04:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOaWTjGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:04:36 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fe35c2-8868-4cfd-b811-7008223d0a30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:04:36 user nova-compute[74880]: No targets found.
Nov 15 02:04:36 user nova-compute[74880]: iSNS:
Nov 15 02:04:36 user nova-compute[74880]: No targets found.
Nov 15 02:04:36 user nova-compute[74880]: STATIC:
Nov 15 02:04:36 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647
Nov 15 02:04:36 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:04:36 user nova-compute[74880]:                 Iface Name: default
Nov 15 02:04:36 user nova-compute[74880]: FIRMWARE:
Nov 15 02:04:36 user nova-compute[74880]: No targets found.
Nov 15 02:04:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:04:36 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:04:36 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df6a2f0-e1e2-4fcc-b5ab-47d6b5e76882]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[611b8c05-94ed-4851-8f22-12b37a40e71d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 (non-flash)
Nov 15 02:04:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 (non-flash)
Nov 15 02:04:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94d05492d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e2e437-c35b-4306-837b-866975e5e106]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b3a58-7018-45fd-a596-781f30d4cda9]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d296792-81e1-4e1c-832c-0cc32e78e35a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f25c03d-ed52-4ea8-b188-1f9cda4fb515]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abab678-3cf0-431a-9947-3dfb23a754a5]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a83ba5b-34ca-43b0-8971-eaf83cbf493b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260]
Nov 15 02:04:36 user nova-compute[74880]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647, portal: 172.16.0.220,3260] successful.
Nov 15 02:04:36 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f1d24d-ed87-4eef-88ce-b33755706647 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8e2e0-a8ab-4157-9f44-9aeb62af93a7]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== disconnect_volume: return (298ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:04:36 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:04:37 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:04:37 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3eaebdbe-a691-459d-9656-a1265f861cf9 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:04:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:04:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:43 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:04:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:04:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:04:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:04:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:04:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:05:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:05:08 user nova-compute[74880]: INFO nova.compute.manager [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attaching volume 57d9d426-dbd9-4066-801b-ee848afc9e3c to /dev/vdb
Nov 15 02:05:08 user nova-compute[74880]: DEBUG os_brick.utils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1646f9-15b3-46ea-ae11-3182b3dd8a08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb65c50-8131-41e2-90c7-811f620e0e71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8411f25-3f29-4dfd-805e-296b43f2fb86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0307a2-ec46-4865-ad61-172747c4e08e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:05:08 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:05:08 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cc2d96-a677-4261-b822-846de5967e87]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG os_brick.utils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:05:08 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating existing volume attachment record: 78c46bc3-0025-4c69-be26-bc0caf25a26f {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:05:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAtmBMdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:05:12 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:05:12 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:05:12 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3ffa1-e56d-407d-9140-1ca6220f5c72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:05:12 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc3387-b35c-4077-99f5-1e513bbbffba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c] added
Nov 15 02:05:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1effb-83e0-4785-868c-a0707c0808ed]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaaef08-4ccf-4729-b121-cd87f15626de]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAtmBMdI {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAtmBMdI" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa63cb8-3479-4745-8919-3a0c1c66087d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pAtmBMdI'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa64297-2c97-4304-ab71-a14031b4929d]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d35cd8-beaf-4a7e-b993-99776c2f9366]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:05:12 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:05:12 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:05:12 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 02:05:12 user nova-compute[74880]: 
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8067765-ec4e-466d-825f-581b47438317]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260]
Nov 15 02:05:12 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260] successful.
Nov 15 02:05:12 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[610aa39e-b2f7-40c9-912a-f7b313ac18d3]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:12 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ef351-d98d-44c4-af91-b3dc54b2de18]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c (non-flash)
Nov 15 02:05:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c (non-flash)
Nov 15 02:05:13 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[849b8881-354b-4e89-8e27-c8e3ca64bfdc]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:13 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAtmBMdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26535333062356138', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535333062356138', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG nova.objects.instance [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:05:14 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:05:14 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:05:14 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:05:14 user nova-compute[74880]:   <serial>57d9d426-dbd9-4066-801b-ee848afc9e3c</serial>
Nov 15 02:05:14 user nova-compute[74880]: </disk>
Nov 15 02:05:14 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No VIF found with MAC fa:16:3e:e8:ad:74, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:05:14 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-7e90dcc9-50ca-41ff-a9ff-bfde4b5f4bf5 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.420s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:05:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:05:17 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:05:17 user nova-compute[74880]: INFO nova.compute.manager [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Detaching volume 57d9d426-dbd9-4066-801b-ee848afc9e3c
Nov 15 02:05:17 user nova-compute[74880]: INFO nova.virt.block_device [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attempting to driver detach volume 57d9d426-dbd9-4066-801b-ee848afc9e3c from mountpoint /dev/vdb
Nov 15 02:05:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Attempting to detach device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:05:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:05:17 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:05:17 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:05:17 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:05:17 user nova-compute[74880]:   <serial>57d9d426-dbd9-4066-801b-ee848afc9e3c</serial>
Nov 15 02:05:17 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:05:17 user nova-compute[74880]: </disk>
Nov 15 02:05:17 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:05:17 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config.
Nov 15 02:05:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:05:17 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:05:17 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:05:17 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:05:17 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:05:17 user nova-compute[74880]:   <serial>57d9d426-dbd9-4066-801b-ee848afc9e3c</serial>
Nov 15 02:05:17 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:05:17 user nova-compute[74880]: </disk>
Nov 15 02:05:17 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:05:18 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:05:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:05:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:05:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:05:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:05:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:05:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:24 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:25 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:05:26 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:05:27 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.180870056152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 86be2742-52a8-4266-a0c3-e6ec542de060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing inventories for resource provider 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating ProviderTree inventory for provider 51756651-d511-4749-8c0a-4c67c2051bce from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Updating inventory in ProviderTree for provider 51756651-d511-4749-8c0a-4c67c2051bce with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing aggregate associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, aggregates: None {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Refreshing trait associations for resource provider 51756651-d511-4749-8c0a-4c67c2051bce, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74880) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 02:05:27 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:05:28 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:05:28 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:05:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:05:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:05:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:32 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 02:05:32 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] There are 0 instances to clean {{(pid=74880) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 02:05:33 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:33 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:05:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:38 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 is timed out.
Nov 15 02:05:38 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config.
Nov 15 02:05:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAtmBMdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:05:38 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c04ddb-12cf-4fc5-95a5-81881fca2d19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:05:38 user nova-compute[74880]: No targets found.
Nov 15 02:05:38 user nova-compute[74880]: iSNS:
Nov 15 02:05:38 user nova-compute[74880]: No targets found.
Nov 15 02:05:38 user nova-compute[74880]: STATIC:
Nov 15 02:05:38 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c
Nov 15 02:05:38 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:05:38 user nova-compute[74880]:                 Iface Name: default
Nov 15 02:05:38 user nova-compute[74880]: FIRMWARE:
Nov 15 02:05:38 user nova-compute[74880]: No targets found.
Nov 15 02:05:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:05:38 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:05:38 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[25566698-776d-4376-a307-41041f2404d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff4bc3-cc11-44bc-b480-6a0c3c3d44b5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c (non-flash)
Nov 15 02:05:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c (non-flash)
Nov 15 02:05:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f950811d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed270f-c212-4602-b2cb-888207c2acae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.044s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcbada5-2bd8-490e-9f31-78860ce3732f]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bdf8cc-f57c-4d74-9412-6b449ab53091]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f3dc0-b82c-4bc7-9e19-b94d57ab7b13]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ffdf06-1acc-40db-80d8-850704f7a2ff]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa07c867-bb90-4418-9d69-9c592c0b034d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260]
Nov 15 02:05:38 user nova-compute[74880]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c, portal: 172.16.0.220,3260] successful.
Nov 15 02:05:38 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d9d426-dbd9-4066-801b-ee848afc9e3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f153b0fd-8c4d-4bfc-a9e1-6049305f9c0a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== disconnect_volume: return (314ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:05:38 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:39 user nova-compute[74880]: DEBUG nova.objects.instance [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:05:39 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-b3d284c8-3479-4e28-b4bf-2e35d9ff98e6 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.618s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:05:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:05:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:05:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:55 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74880) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 02:05:55 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:05:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:06:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:06:09 user nova-compute[74880]: INFO nova.compute.manager [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attaching volume 061cd01e-78c2-46ad-bec8-cd76888b1835 to /dev/vdb
Nov 15 02:06:09 user nova-compute[74880]: DEBUG os_brick.utils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a9841-871b-4e0b-b64a-22518d6323e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278d71ac3d73\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbeee13-d6db-4703-8edb-3914309fa5b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0221afd7-8f0c-4069-acba-970e35b9acf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a31ad2e-430f-481c-a46c-01cceda4419c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Running cmd (subprocess): nvme version {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] 'nvme version' failed. Not Retrying. {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:06:09 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] nvme not present on system {{(pid=74880) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 02:06:10 user nova-compute[74880]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 02:06:10 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6651da85-738d-443c-9487-74e29dc92865]: (4, '') {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74880) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] LIGHTOS: no hostnqn found. {{(pid=74880) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG os_brick.utils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278d71ac3d73', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:06:10 user nova-compute[74880]: DEBUG nova.virt.block_device [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating existing volume attachment record: fafca2ee-f97d-4c9f-adf2-7d7814c9be6d {{(pid=74880) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 02:06:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Calling os-brick to attach iSCSI Volume {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKTRJutC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:06:14 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:06:14 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:06:14 user nova-compute[74880]: INFO os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b10321-992f-4f11-825a-93a202207dc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 02:06:14 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --interface default --op new {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d737fd-529e-4650-a6bf-5e1b163c7405]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835] added\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835] added
Nov 15 02:06:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2048d4-b920-4555-8ff3-42dec1976fbb]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a20812-db8a-4f1a-91bf-5b53b7a42727]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKTRJutC {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKTRJutC" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a09e5f-8406-4bdf-910c-3c152f813a8a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZKTRJutC'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0727e6-7a1b-4236-9e56-a70ddadd48d2]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0028fc6e-49d1-4676-8887-0359ee511fa6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:06:14 user nova-compute[74880]:  {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 02:06:14 user nova-compute[74880]:  {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:06:14 user nova-compute[74880]: WARNING os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 02:06:14 user nova-compute[74880]: 
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --login {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f10434a-f669-4bdc-8028-887d5b8e6cf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260]
Nov 15 02:06:14 user nova-compute[74880]: Login to [iface: default, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260] successful.
Nov 15 02:06:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb823b1-6825-466d-9bc6-6394cd5f682a]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1808c4-3516-43e7-bebc-f22988fd1b6e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 (non-flash)
Nov 15 02:06:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 (non-flash)
Nov 15 02:06:14 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to 172.16.0.220:3260 {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74880) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74880) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b73b3-8fca-4da2-a522-6958275d1fdb]: (4, ('- - 0', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74880) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 02:06:14 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKTRJutC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74880) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 02:06:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:06:15 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26166323463373233', 'path': '/dev/sdb'} {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:06:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166323463373233', 'path': '/dev/sdb'} {{(pid=74880) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 02:06:15 user nova-compute[74880]: DEBUG nova.objects.instance [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:06:15 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 02:06:15 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:06:15 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:06:15 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:06:15 user nova-compute[74880]:   <serial>061cd01e-78c2-46ad-bec8-cd76888b1835</serial>
Nov 15 02:06:15 user nova-compute[74880]: </disk>
Nov 15 02:06:15 user nova-compute[74880]:  {{(pid=74880) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 02:06:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:06:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74880) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 02:06:16 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] No VIF found with MAC fa:16:3e:e8:ad:74, not building metadata {{(pid=74880) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 02:06:16 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-2cc0dd81-e904-494d-abeb-38c0c503c1a3 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.626s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:06:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:06:19 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:06:19 user nova-compute[74880]: INFO nova.compute.manager [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Detaching volume 061cd01e-78c2-46ad-bec8-cd76888b1835
Nov 15 02:06:19 user nova-compute[74880]: INFO nova.virt.block_device [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Attempting to driver detach volume 061cd01e-78c2-46ad-bec8-cd76888b1835 from mountpoint /dev/vdb
Nov 15 02:06:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Attempting to detach device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config. {{(pid=74880) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 02:06:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:06:19 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:06:19 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:06:19 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:06:19 user nova-compute[74880]:   <serial>061cd01e-78c2-46ad-bec8-cd76888b1835</serial>
Nov 15 02:06:19 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:06:19 user nova-compute[74880]: </disk>
Nov 15 02:06:19 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:06:19 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the persistent domain config.
Nov 15 02:06:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config. {{(pid=74880) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 02:06:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.guest [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 02:06:19 user nova-compute[74880]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 02:06:19 user nova-compute[74880]:   <source dev="/dev/sdb"/>
Nov 15 02:06:19 user nova-compute[74880]:   <target dev="vdb" bus="virtio"/>
Nov 15 02:06:19 user nova-compute[74880]:   <serial>061cd01e-78c2-46ad-bec8-cd76888b1835</serial>
Nov 15 02:06:19 user nova-compute[74880]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 02:06:19 user nova-compute[74880]: </disk>
Nov 15 02:06:19 user nova-compute[74880]:  {{(pid=74880) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 02:06:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:19 user nova-compute[74880]: DEBUG nova.virt.libvirt.driver [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:06:20 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:06:21 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:06:21 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:06:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:06:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:24 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:28 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:29 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:06:29 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.179935455322266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Instance 86be2742-52a8-4266-a0c3-e6ec542de060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74880) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:06:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:06:30 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:34 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:35 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:35 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:06:39 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86be2742-52a8-4266-a0c3-e6ec542de060 is timed out.
Nov 15 02:06:39 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully detached device vdb from instance 86be2742-52a8-4266-a0c3-e6ec542de060 from the live domain config.
Nov 15 02:06:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] calling os-brick to detach iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f95081677f0>, {'target_iqn': 'iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKTRJutC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 02:06:39 user nova-compute[74880]: WARNING os_brick.initiator.connectors.base [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1090536-1aa7-4f18-a157-e6819aec6026]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 02:06:39 user nova-compute[74880]: No targets found.
Nov 15 02:06:39 user nova-compute[74880]: iSNS:
Nov 15 02:06:39 user nova-compute[74880]: No targets found.
Nov 15 02:06:39 user nova-compute[74880]: STATIC:
Nov 15 02:06:39 user nova-compute[74880]: Target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835
Nov 15 02:06:39 user nova-compute[74880]:         Portal: 172.16.0.220:3260,-1
Nov 15 02:06:39 user nova-compute[74880]:                 Iface Name: default
Nov 15 02:06:39 user nova-compute[74880]: FIRMWARE:
Nov 15 02:06:39 user nova-compute[74880]: No targets found.
Nov 15 02:06:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 02:06:39 user nova-compute[74880]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 02:06:39 user nova-compute[74880]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74880) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835', 0)] {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9eaa9-4c26-492f-8f7c-daf3433b781a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacb2459-b082-4e2a-a3c5-d118392f4a97]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 (non-flash)\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 (non-flash)
Nov 15 02:06:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 (non-flash)
Nov 15 02:06:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9513825900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835'): ({'sdb'}, set())}) {{(pid=74880) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Removing single pathed devices sdb {{(pid=74880) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28851442-3cc8-4841-922a-dab97a35b12f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247f590-1a51-4005-a413-2010262d3392]: (4, ('ok\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Flushing IO for device /dev/sdb {{(pid=74880) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce61c75-17b3-413d-ae44-04d01cc490b6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74880) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[554edcd7-2c86-41b1-9e82-00a306ed0f82]: (4, ('1', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] SCSI volumes sdb have been removed. {{(pid=74880) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835')] {{(pid=74880) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e0880d-484f-46fb-994d-5d2f0603fcf6]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --logout {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c22434-ce9a-4e46-90d0-f162e276aa7f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260]
Nov 15 02:06:39 user nova-compute[74880]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835, portal: 172.16.0.220,3260] successful.
Nov 15 02:06:39 user nova-compute[74880]:  stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op delete {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061cd01e-78c2-46ad-bec8-cd76888b1835 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85948) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ee422-c38f-4efa-956e-0c99198a3f40]: (4, ('', '')) {{(pid=85948) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74880) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.base [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] <== disconnect_volume: return (282ms) None {{(pid=74880) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 02:06:39 user nova-compute[74880]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Disconnected iSCSI Volume {{(pid=74880) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 02:06:40 user nova-compute[74880]: DEBUG nova.objects.instance [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'flavor' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:06:40 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-3c4f201d-e910-4345-9ab2-bdbf6b01b248 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:06:44 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:45 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:06:49 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:54 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:06:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:06:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:06:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:06:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:06:59 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:04 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:07:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:09 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:07:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:14 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:07:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:21 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:07:21 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquired lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Forcefully refreshing network info cache for instance {{(pid=74880) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG nova.objects.instance [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lazy-loading 'info_cache' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG nova.network.neutron [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [{"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Releasing lock "refresh_cache-86be2742-52a8-4266-a0c3-e6ec542de060" {{(pid=74880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 02:07:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updated the network info_cache for instance {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:23 user nova-compute[74880]: INFO nova.compute.manager [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Terminating instance
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.compute.manager [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Start destroying the instance on the hypervisor. {{(pid=74880) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-71aad4a6-36cd-46cc-a343-5645e4ebc771 req-b762cf30-8af6-4ea6-b564-dd9059dff4ad service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-vif-unplugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-71aad4a6-36cd-46cc-a343-5645e4ebc771 req-b762cf30-8af6-4ea6-b564-dd9059dff4ad service nova] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-71aad4a6-36cd-46cc-a343-5645e4ebc771 req-b762cf30-8af6-4ea6-b564-dd9059dff4ad service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-71aad4a6-36cd-46cc-a343-5645e4ebc771 req-b762cf30-8af6-4ea6-b564-dd9059dff4ad service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-71aad4a6-36cd-46cc-a343-5645e4ebc771 req-b762cf30-8af6-4ea6-b564-dd9059dff4ad service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] No waiting events found dispatching network-vif-unplugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.compute.manager [req-71aad4a6-36cd-46cc-a343-5645e4ebc771 req-b762cf30-8af6-4ea6-b564-dd9059dff4ad service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-vif-unplugged-11b99bc9-8f22-4086-8608-33001c8413da for instance with task_state deleting. {{(pid=74880) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [-] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Instance destroyed successfully.
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.objects.instance [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lazy-loading 'resources' on Instance uuid 86be2742-52a8-4266-a0c3-e6ec542de060 {{(pid=74880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.virt.libvirt.vif [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T02:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1838768601',display_name='tempest-SnapshotDataIntegrityTests-server-1838768601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1838768601',id=53,image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe5NpITyt3uuOcOmuiDUiC6/69p4rOq6FBNH5s/+aIOeRdk4YvHjN5GWJxfinR308ddFtJSwFpDvmrO4g8uf3HVMiLcNpyLuxAGF5tb8QM72XJQYgX58TP3vlHbyGBJAA==',key_name='tempest-keypair-1106201018',keypairs=<?>,launch_index=0,launched_at=2023-11-15T02:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0681eb78da94b978840014a68473771',ramdisk_id='',reservation_id='r-to9r7kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e9b279c-74a4-42a5-b459-aec607e3df19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-580942294',owner_user_name='tempest-SnapshotDataIntegrityTests-580942294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T02:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81f6dff5dc294c418de648667b7979e4',uuid=86be2742-52a8-4266-a0c3-e6ec542de060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Converting VIF {"id": "11b99bc9-8f22-4086-8608-33001c8413da", "address": "fa:16:3e:e8:ad:74", "network": {"id": "35545b0c-451e-4f1f-a51c-7a374fbb4306", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1959943815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0681eb78da94b978840014a68473771", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b99bc9-8f", "ovs_interfaceid": "11b99bc9-8f22-4086-8608-33001c8413da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.network.os_vif_util [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f') {{(pid=74880) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG os_vif [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f') {{(pid=74880) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b99bc9-8f, bridge=br-int, if_exists=True) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b1b1bf2-87b4-44be-b17a-6e03532cf8ca) {{(pid=74880) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:23 user nova-compute[74880]: INFO os_vif [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ad:74,bridge_name='br-int',has_traffic_filtering=True,id=11b99bc9-8f22-4086-8608-33001c8413da,network=Network(35545b0c-451e-4f1f-a51c-7a374fbb4306),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b99bc9-8f')
Nov 15 02:07:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Deleting instance files /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060_del
Nov 15 02:07:23 user nova-compute[74880]: INFO nova.virt.libvirt.driver [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Deletion of /opt/stack/data/nova/instances/86be2742-52a8-4266-a0c3-e6ec542de060_del complete
Nov 15 02:07:23 user nova-compute[74880]: INFO nova.compute.manager [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 02:07:23 user nova-compute[74880]: DEBUG oslo.service.loopingcall [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74880) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.compute.manager [-] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Deallocating network for instance {{(pid=74880) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 02:07:23 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] deallocate_for_instance() {{(pid=74880) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 02:07:24 user nova-compute[74880]: DEBUG nova.network.neutron [-] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Updating instance_info_cache with network_info: [] {{(pid=74880) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 02:07:24 user nova-compute[74880]: INFO nova.compute.manager [-] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Took 0.64 seconds to deallocate network for instance.
Nov 15 02:07:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:24 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:07:24 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:07:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:24 user nova-compute[74880]: INFO nova.scheduler.client.report [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Deleted allocations for instance 86be2742-52a8-4266-a0c3-e6ec542de060
Nov 15 02:07:24 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-e2329b5b-5789-4d1d-b61a-0fac06f7c8c8 tempest-SnapshotDataIntegrityTests-580942294 tempest-SnapshotDataIntegrityTests-580942294-project-member] Lock "86be2742-52a8-4266-a0c3-e6ec542de060" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.804s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:07:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] Acquiring lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:25 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] Lock "86be2742-52a8-4266-a0c3-e6ec542de060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] No waiting events found dispatching network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 02:07:25 user nova-compute[74880]: WARNING nova.compute.manager [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received unexpected event network-vif-plugged-11b99bc9-8f22-4086-8608-33001c8413da for instance with vm_state deleted and task_state None.
Nov 15 02:07:25 user nova-compute[74880]: DEBUG nova.compute.manager [req-3bd201ce-b07b-4d74-aa05-499c064559fd req-5e8471c2-13b9-4f70-819b-31e6a8526693 service nova] [instance: 86be2742-52a8-4266-a0c3-e6ec542de060] Received event network-vif-deleted-11b99bc9-8f22-4086-8608-33001c8413da {{(pid=74880) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 02:07:26 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:27 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:29 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:29 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:07:30 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:07:30 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:07:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=25.199234008789062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:07:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:07:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:34 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:36 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:36 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:07:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:41 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:07:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:07:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:43 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:48 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 02:07:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74880) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 02:07:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74880) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 02:07:53 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:07:58 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:03 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:08 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:13 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:17 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:18 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:19 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:22 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Starting heal instance info cache {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 02:08:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Rebuilding the list of instances to heal {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 02:08:22 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Didn't find any instances for network info cache update. {{(pid=74880) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 02:08:23 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:28 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:28 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:28 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:29 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:29 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:08:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:08:29 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:08:29 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Auditing locally available compute resources for user (node: user) {{(pid=74880) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 02:08:30 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:08:30 user nova-compute[74880]: WARNING nova.virt.libvirt.driver [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 02:08:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Hypervisor/Node resource view: name=user free_ram=9254MB free_disk=25.198135375976562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74880) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74880) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG nova.compute.provider_tree [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed in ProviderTree for provider: 51756651-d511-4749-8c0a-4c67c2051bce {{(pid=74880) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG nova.scheduler.client.report [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Inventory has not changed for provider 51756651-d511-4749-8c0a-4c67c2051bce based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74880) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG nova.compute.resource_tracker [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Compute_service record updated for user:user {{(pid=74880) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 02:08:30 user nova-compute[74880]: DEBUG oslo_concurrency.lockutils [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74880) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 02:08:31 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:33 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 02:08:35 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:38 user nova-compute[74880]: DEBUG oslo_service.periodic_task [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 02:08:38 user nova-compute[74880]: DEBUG nova.compute.manager [None req-9748862c-063e-4f00-908f-63eaa1ede817 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74880) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 02:08:38 user nova-compute[74880]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74880) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}